Aug 26 17:35:42 user nova-compute[73110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 17:35:44 user nova-compute[73110]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73110) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 17:35:44 user nova-compute[73110]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73110) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 17:35:44 user nova-compute[73110]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73110) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 17:35:44 user nova-compute[73110]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:35:45 user nova-compute[73110]: INFO nova.virt.driver [None req-034b4713-1839-436a-804b-d99d22701488 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 17:35:45 user nova-compute[73110]: INFO nova.compute.provider_config [None req-034b4713-1839-436a-804b-d99d22701488 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-034b4713-1839-436a-804b-d99d22701488 None None] Acquiring lock "singleton_lock" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-034b4713-1839-436a-804b-d99d22701488 None None] Acquired lock "singleton_lock" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-034b4713-1839-436a-804b-d99d22701488 None None] Releasing lock "singleton_lock" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] Full set of CONF: {{(pid=73110) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ******************************************************************************** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] Configuration options gathered from: {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ================================================================================ {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] allow_resize_to_same_host      = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] arq_binding_timeout            = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] backdoor_port                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] backdoor_socket                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] block_device_allocate_retries  = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] block_device_allocate_retries_interval = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cert                           = self.pem {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute_monitors               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] config_dir                     = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] config_drive_format            = iso9660 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] config_source                  = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] console_host                   = user {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] control_exchange               = nova {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cpu_allocation_ratio           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] daemon                         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] debug                          = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_access_ip_network_name = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_availability_zone      = nova {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_ephemeral_format       = ext4 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_green_pool_size        = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] default_schedule_zone          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] disk_allocation_ratio          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] enable_new_services            = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] enabled_ssl_apis               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] flat_injected                  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] force_config_drive             = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] force_raw_images               = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] graceful_shutdown_timeout      = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] heal_instance_info_cache_interval = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] host                           = user {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_build_timeout         = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_delete_interval       = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_name_template         = instance-%08x {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_usage_audit           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_usage_audit_period    = month {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] internal_service_availability_zone = internal {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] key                            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] live_migration_retry_count     = 30 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_config_append              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_dir                        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_file                       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_options                    = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_rotate_interval            = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_rotate_interval_type       = days {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] log_rotation_type              = none {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] long_rpc_timeout               = 1800 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_concurrent_builds          = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_concurrent_live_migrations = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_concurrent_snapshots       = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_local_block_devices        = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_logfile_count              = 30 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] max_logfile_size_mb            = 200 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] maximum_instance_delete_attempts = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metadata_listen                = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metadata_listen_port           = 8775 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metadata_workers               = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] migrate_max_retries            = -1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] mkisofs_cmd                    = genisoimage {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] my_ip                          = 10.0.0.210 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] network_allocate_retries       = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] osapi_compute_listen_port      = 8774 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] osapi_compute_unique_server_name_scope =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] osapi_compute_workers          = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] password_length                = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] periodic_enable                = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] periodic_fuzzy_delay           = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] pointer_model                  = ps2mouse {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] preallocate_images             = none {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] publish_errors                 = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] pybasedir                      = /opt/stack/nova {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ram_allocation_ratio           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rate_limit_burst               = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rate_limit_except_level        = CRITICAL {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rate_limit_interval            = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reboot_timeout                 = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reclaim_instance_interval      = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] record                         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reimage_timeout_per_gb         = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] report_interval                = 120 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rescue_timeout                 = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reserved_host_cpus             = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reserved_host_disk_mb          = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reserved_host_memory_mb        = 512 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] reserved_huge_pages            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] resize_confirm_window          = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] resize_fs_using_block_device   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] resume_guests_state_on_host_boot = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rpc_response_timeout           = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] run_external_periodic_tasks    = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] running_deleted_instance_action = reap {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] running_deleted_instance_timeout = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler_instance_sync_interval = 120 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_down_time              = 720 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] servicegroup_driver            = db {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] shelved_offload_time           = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] shelved_poll_interval          = 3600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] shutdown_timeout               = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] source_is_ipv6                 = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ssl_only                       = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] state_path                     = /opt/stack/data/nova {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] sync_power_state_interval      = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] sync_power_state_pool_size     = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] syslog_log_facility            = LOG_USER {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] tempdir                        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] timeout_nbd                    = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] transport_url                  = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] update_resources_interval      = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_cow_images                 = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_eventlog                   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_journal                    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_json                       = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_rootwrap_daemon            = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_stderr                     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] use_syslog                     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vcpu_pin_set                   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plugging_is_fatal          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plugging_timeout           = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] virt_mkfs                      = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] volume_usage_poll_interval     = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] watch_log_file                 = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] web                            = /usr/share/spice-html5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_concurrency.disable_process_locking = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.auth_strategy              = keystone {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.compute_link_prefix        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.dhcp_domain                = novalocal {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.enable_instance_password   = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.glance_link_prefix         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.instance_list_per_project_cells = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.list_records_by_skipping_down_cells = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.local_metadata_per_cell    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.max_limit                  = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.metadata_cache_expiration  = 15 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.neutron_default_tenant_id  = default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.use_forwarded_for          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.use_neutron_default_nets   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_dynamic_targets = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_jsonfile_path   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.backend_argument         = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.config_prefix            = cache.oslo {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.dead_timeout             = 60.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.debug_cache_backend      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.enable_retry_client      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.enable_socket_keepalive  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.enabled                  = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.expiration_time          = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.hashclient_retry_attempts = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_dead_retry      = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_password        =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_sasl_enabled    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.memcache_username        =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.proxies                  = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.retry_attempts           = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.retry_delay              = 0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.socket_keepalive_count   = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.socket_keepalive_idle    = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.socket_keepalive_interval = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.tls_allowed_ciphers      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.tls_cafile               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.tls_certfile             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.tls_enabled              = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cache.tls_keyfile              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.auth_section            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.auth_type               = password {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.cafile                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.certfile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.collect_timing          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.cross_az_attach         = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.debug                   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.endpoint_template       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.http_retries            = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.insecure                = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.keyfile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.os_region_name          = RegionOne {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.split_loggers           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cinder.timeout                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.cpu_dedicated_set      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.cpu_shared_set         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.image_type_exclude_list = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.resource_provider_association_refresh = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.shutdown_retry_interval = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] conductor.workers              = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] console.allowed_origins        = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] console.ssl_ciphers            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] console.ssl_minimum_version    = default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] consoleauth.token_ttl          = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.cafile                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.certfile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.collect_timing          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.connect_retries         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.connect_retry_delay     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.endpoint_override       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.insecure                = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.keyfile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.max_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.min_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.region_name             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.service_name            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.service_type            = accelerator {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.split_loggers           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.status_code_retries     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.timeout                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] cyborg.version                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.backend               = sqlalchemy {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.connection            = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.connection_debug      = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.connection_parameters =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.connection_recycle_time = 3600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.connection_trace      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.db_inc_retry_interval = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.db_max_retries        = 20 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.db_max_retry_interval = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.db_retry_interval     = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.max_overflow          = 50 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.max_pool_size         = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.max_retries           = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.mysql_enable_ndb      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.mysql_wsrep_sync_wait = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.pool_timeout          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.retry_interval        = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.slave_connection      = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] database.sqlite_synchronous    = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.backend           = sqlalchemy {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.connection        = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.connection_debug  = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.connection_parameters =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.connection_recycle_time = 3600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.connection_trace  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.db_inc_retry_interval = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.db_max_retries    = 20 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.db_max_retry_interval = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.db_retry_interval = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.max_overflow      = 50 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.max_pool_size     = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.max_retries       = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.mysql_enable_ndb  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.pool_timeout      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.retry_interval    = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.slave_connection  = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] api_database.sqlite_synchronous = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] devices.enabled_mdev_types     = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ephemeral_storage_encryption.enabled = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.api_servers             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.cafile                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.certfile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.collect_timing          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.connect_retries         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.connect_retry_delay     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.debug                   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.default_trusted_certificate_ids = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.enable_certificate_validation = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.enable_rbd_download     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.endpoint_override       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.insecure                = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.keyfile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.max_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.min_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.num_retries             = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.rbd_ceph_conf           =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.rbd_connect_timeout     = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.rbd_pool                =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.rbd_user                =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.region_name             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.service_name            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.service_type            = image {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.split_loggers           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.status_code_retries     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.timeout                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.verify_glance_signatures = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] glance.version                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] guestfs.debug                  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.config_drive_cdrom      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.config_drive_inject_password = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.enable_remotefx         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.instances_path_share    =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.limit_cpu_features      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.use_multipath_io        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.vswitch_name            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] mks.enabled                    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.manager_interval   = 2400 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.precache_concurrency = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.remove_unused_base_images = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] image_cache.subdirectory_name  = _base {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.api_max_retries         = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.api_retry_interval      = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.auth_section            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.auth_type               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.cafile                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.certfile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.collect_timing          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.connect_retries         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.connect_retry_delay     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.endpoint_override       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.insecure                = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.keyfile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.max_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.min_version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.partition_key           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.peer_list               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.region_name             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.serial_console_state_timeout = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.service_name            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.service_type            = baremetal {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.split_loggers           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.status_code_retries     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.timeout                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ironic.version                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] key_manager.fixed_key          = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.barbican_api_version  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.barbican_endpoint     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.barbican_endpoint_type = public {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.barbican_region_name  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.cafile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.certfile              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.collect_timing        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.insecure              = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.keyfile               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.number_of_retries     = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.retry_delay           = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.send_service_user_token = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.split_loggers         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.timeout               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.verify_ssl            = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican.verify_ssl_path       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.auth_section = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.auth_type = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.cafile   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.certfile = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.collect_timing = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.insecure = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.keyfile  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.split_loggers = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] barbican_service_user.timeout  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.approle_role_id          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.approle_secret_id        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.cafile                   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.certfile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.collect_timing           = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.insecure                 = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.keyfile                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.kv_mountpoint            = secret {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.kv_version               = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.namespace                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.root_token_id            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.split_loggers            = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.ssl_ca_crt_file          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.timeout                  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.use_ssl                  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.cafile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.certfile              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.collect_timing        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.connect_retries       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.connect_retry_delay   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.endpoint_override     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.insecure              = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.keyfile               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.max_version           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.min_version           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.region_name           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.service_name          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.service_type          = identity {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.split_loggers         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.status_code_retries   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.timeout               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] keystone.version               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.connection_uri         =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_mode               = custom {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: WARNING oslo_config.cfg [None req-034b4713-1839-436a-804b-d99d22701488 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_power_governor_high = performance {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_power_management   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.device_detach_attempts = 8 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.device_detach_timeout  = 20 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.disk_cachemodes        = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.disk_prefix            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.enabled_perf_events    = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.file_backed_memory     = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.gid_maps               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.hw_disk_discard        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.hw_machine_type        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_rbd_pool        = rbd {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_type            = default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.images_volume_group    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.inject_key             = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.inject_partition       = -2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.inject_password        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.iscsi_iface            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.iser_use_multipath     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_downtime = 500 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_inbound_addr = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_scheme  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_timeout_action = abort {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_tunnelled = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: WARNING oslo_config.cfg [None req-034b4713-1839-436a-804b-d99d22701488 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 17:35:45 user nova-compute[73110]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 17:35:45 user nova-compute[73110]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 17:35:45 user nova-compute[73110]: and ``live_migration_inbound_addr`` respectively.
Aug 26 17:35:45 user nova-compute[73110]: ).  Its value may be silently ignored in the future.
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.live_migration_with_native_tls = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.max_queues             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.nfs_mount_options      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_pcie_ports         = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.pmem_namespaces        = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.quobyte_client_cfg     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rbd_secret_uuid        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rbd_user               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rescue_image_id        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rescue_kernel_id       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.rx_queue_size          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.smbfs_mount_options    =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.snapshot_compression   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.snapshot_image_format  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.sparse_logical_volumes = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.swtpm_enabled          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.swtpm_group            = tss {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.swtpm_user             = tss {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.sysinfo_serial         = unique {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.tb_cache_size          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.tx_queue_size          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.uid_maps               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.use_virtio_for_bridges = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.virt_type              = kvm {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.volume_clear           = zero {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.volume_clear_size      = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.volume_use_multipath   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_cache_path   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.auth_section           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.auth_type              = password {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.cafile                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.certfile               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.collect_timing         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.connect_retries        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.connect_retry_delay    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.default_floating_pool  = public {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.endpoint_override      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.extension_sync_interval = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.http_retries           = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.insecure               = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.keyfile                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.max_version            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.min_version            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.ovs_bridge             = br-int {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.physnets               = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.region_name            = RegionOne {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.service_metadata_proxy = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.service_name           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.service_type           = network {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.split_loggers          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.status_code_retries    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.timeout                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] neutron.version                = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] notifications.bdms_in_notifications = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] notifications.default_level    = INFO {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] notifications.notification_format = unversioned {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] notifications.notify_on_state_change = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] pci.alias                      = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] pci.device_spec                = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] pci.report_in_placement        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.auth_section         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.auth_type            = password {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.cafile               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.certfile             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.collect_timing       = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.connect_retries      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.connect_retry_delay  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.default_domain_id    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.default_domain_name  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.domain_id            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.domain_name          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.endpoint_override    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.insecure             = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.keyfile              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.max_version          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.min_version          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.password             = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.project_domain_id    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.project_domain_name  = Default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.project_id           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.project_name         = service {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.region_name          = RegionOne {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.service_name         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.service_type         = placement {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.split_loggers        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.status_code_retries  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.system_scope         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.timeout              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.trust_id             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.user_domain_id       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.user_domain_name     = Default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.user_id              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.username             = placement {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] placement.version              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.cores                    = 20 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.count_usage_from_placement = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.injected_file_content_bytes = 10240 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.injected_file_path_length = 255 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.injected_files           = 5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.instances                = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.key_pairs                = 100 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.metadata_items           = 128 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.ram                      = 51200 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.recheck_quota            = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.server_group_members     = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] quota.server_groups            = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rdp.enabled                    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.image_metadata_prefilter = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.max_attempts         = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.max_placement_results = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] scheduler.workers              = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.host_subset_size = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.isolated_hosts = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.isolated_images = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.pci_in_placement = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.track_instance_changes = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metrics.required               = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metrics.weight_multiplier      = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] metrics.weight_setting         = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.enabled         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.port_range      = 10000:20000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] serial_console.serialproxy_port = 6083 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.auth_section      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.auth_type         = password {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.cafile            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.certfile          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.collect_timing    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.insecure          = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.keyfile           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.send_service_user_token = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.split_loggers     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] service_user.timeout           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.agent_enabled            = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.enabled                  = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.html5proxy_port          = 6082 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.image_compression        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.jpeg_compression         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.playback_compression     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.server_listen            = 127.0.0.1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.streaming_mode           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] spice.zlib_compression         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] upgrade_levels.baseapi         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] upgrade_levels.cert            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] upgrade_levels.compute         = auto {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] upgrade_levels.conductor       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] upgrade_levels.scheduler       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.cafile = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.certfile = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.insecure = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vendordata_dynamic_auth.timeout = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.api_retry_count         = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.ca_file                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.cache_prefix            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.cluster_name            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.connection_pool_size    = 10 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.console_delay_seconds   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.datastore_regex         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.host_ip                 = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.host_password           = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.host_port               = 443 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.host_username           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.insecure                = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.integration_bridge      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.maximum_objects         = 100 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.pbm_default_policy      = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.pbm_enabled             = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.pbm_wsdl_location       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.serial_port_proxy_uri   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.serial_port_service_uri = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.task_poll_interval      = 0.5 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.use_linked_clone        = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.vnc_keymap              = en-us {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.vnc_port                = 5900 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vmware.vnc_port_total          = 10000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.auth_schemes               = ['none'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.enabled                    = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.novncproxy_port            = 6080 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.vencrypt_ca_certs          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.vencrypt_client_cert       = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vnc.vencrypt_client_key        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.disable_rootwrap   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.enable_numa_live_migration = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.libvirt_disable_apic = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.client_socket_timeout     = 900 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.default_pool_size         = 1000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.keep_alive                = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.max_header_line           = 16384 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.ssl_ca_file               = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.ssl_cert_file             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.ssl_key_file              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.tcp_keepidle              = 600 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] zvm.ca_file                    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] zvm.cloud_connector_url        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] zvm.reachable_timeout          = 300 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.enforce_new_defaults = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.enforce_scope      = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.policy_default_rule = default {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.connection_string     = messaging:// {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.enabled               = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.es_doc_type           = notification {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.es_scroll_size        = 10000 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.es_scroll_time        = 2m {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.filter_error_trace    = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.hmac_keys             = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.sentinel_service_name = mymaster {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.socket_timeout        = 0.1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.trace_requests        = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler.trace_sqlalchemy      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler_jaeger.process_tags   = {} {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler_jaeger.service_name_prefix = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] profiler_otlp.service_name_prefix = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] remote_debug.host              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] remote_debug.port              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_notifications.retry = -1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.auth_section        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.auth_type           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.cafile              = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.certfile            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.collect_timing      = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.connect_retries     = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.connect_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.endpoint_id         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.endpoint_override   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.insecure            = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.keyfile             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.max_version         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.min_version         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.region_name         = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.service_name        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.service_type        = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.split_loggers       = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.status_code_retries = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.status_code_retry_delay = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.timeout             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.valid_interfaces    = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_limit.version             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_reports.file_event_handler = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] oslo_reports.log_dir           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.group  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] vif_plug_ovs_privileged.user   = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.isolate_vif         = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] os_brick.lock_path             = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.capabilities   = [21] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.group          = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.helper_command = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] privsep_osbrick.user           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.group           = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.helper_command  = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] nova_sys_admin.user            = None {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG oslo_service.service [None req-034b4713-1839-436a-804b-d99d22701488 None None] ******************************************************************************** {{(pid=73110) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 17:35:45 user nova-compute[73110]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Starting native event thread {{(pid=73110) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Starting green dispatch thread {{(pid=73110) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Starting connection event dispatch thread {{(pid=73110) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Connecting to libvirt: qemu:///system {{(pid=73110) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd5688ba7d0> {{(pid=73110) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd5688ba7d0> {{(pid=73110) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 17:35:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Connection event '1' reason 'None'
Aug 26 17:35:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 17:35:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.mount [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Initialising _HostMountState generation 0 {{(pid=73110) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host capabilities <capabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <host>
Aug 26 17:35:53 user nova-compute[73110]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 17:35:53 user nova-compute[73110]:     <cpu>
Aug 26 17:35:53 user nova-compute[73110]:       <arch>x86_64</arch>
Aug 26 17:35:53 user nova-compute[73110]:       <model>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <microcode version='1070'/>
Aug 26 17:35:53 user nova-compute[73110]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='osxsave'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='invtsc'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='rsba'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 17:35:53 user nova-compute[73110]:       <pages unit='KiB' size='4'/>
Aug 26 17:35:53 user nova-compute[73110]:       <pages unit='KiB' size='2048'/>
Aug 26 17:35:53 user nova-compute[73110]:     </cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <power_management>
Aug 26 17:35:53 user nova-compute[73110]:       <suspend_mem/>
Aug 26 17:35:53 user nova-compute[73110]:       <suspend_disk/>
Aug 26 17:35:53 user nova-compute[73110]:       <suspend_hybrid/>
Aug 26 17:35:53 user nova-compute[73110]:     </power_management>
Aug 26 17:35:53 user nova-compute[73110]:     <iommu support='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <migration_features>
Aug 26 17:35:53 user nova-compute[73110]:       <live/>
Aug 26 17:35:53 user nova-compute[73110]:       <uri_transports>
Aug 26 17:35:53 user nova-compute[73110]:         <uri_transport>tcp</uri_transport>
Aug 26 17:35:53 user nova-compute[73110]:         <uri_transport>rdma</uri_transport>
Aug 26 17:35:53 user nova-compute[73110]:       </uri_transports>
Aug 26 17:35:53 user nova-compute[73110]:     </migration_features>
Aug 26 17:35:53 user nova-compute[73110]:     <topology>
Aug 26 17:35:53 user nova-compute[73110]:       <cells num='2'>
Aug 26 17:35:53 user nova-compute[73110]:         <cell id='0'>
Aug 26 17:35:53 user nova-compute[73110]:           <memory unit='KiB'>8189224</memory>
Aug 26 17:35:53 user nova-compute[73110]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 17:35:53 user nova-compute[73110]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 17:35:53 user nova-compute[73110]:           <distances>
Aug 26 17:35:53 user nova-compute[73110]:             <sibling id='0' value='10'/>
Aug 26 17:35:53 user nova-compute[73110]:             <sibling id='1' value='20'/>
Aug 26 17:35:53 user nova-compute[73110]:           </distances>
Aug 26 17:35:53 user nova-compute[73110]:           <cpus num='6'>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 17:35:53 user nova-compute[73110]:           </cpus>
Aug 26 17:35:53 user nova-compute[73110]:         </cell>
Aug 26 17:35:53 user nova-compute[73110]:         <cell id='1'>
Aug 26 17:35:53 user nova-compute[73110]:           <memory unit='KiB'>8206460</memory>
Aug 26 17:35:53 user nova-compute[73110]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 17:35:53 user nova-compute[73110]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 17:35:53 user nova-compute[73110]:           <distances>
Aug 26 17:35:53 user nova-compute[73110]:             <sibling id='0' value='20'/>
Aug 26 17:35:53 user nova-compute[73110]:             <sibling id='1' value='10'/>
Aug 26 17:35:53 user nova-compute[73110]:           </distances>
Aug 26 17:35:53 user nova-compute[73110]:           <cpus num='6'>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 17:35:53 user nova-compute[73110]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 17:35:53 user nova-compute[73110]:           </cpus>
Aug 26 17:35:53 user nova-compute[73110]:         </cell>
Aug 26 17:35:53 user nova-compute[73110]:       </cells>
Aug 26 17:35:53 user nova-compute[73110]:     </topology>
Aug 26 17:35:53 user nova-compute[73110]:     <cache>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 17:35:53 user nova-compute[73110]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 17:35:53 user nova-compute[73110]:     </cache>
Aug 26 17:35:53 user nova-compute[73110]:     <secmodel>
Aug 26 17:35:53 user nova-compute[73110]:       <model>apparmor</model>
Aug 26 17:35:53 user nova-compute[73110]:       <doi>0</doi>
Aug 26 17:35:53 user nova-compute[73110]:     </secmodel>
Aug 26 17:35:53 user nova-compute[73110]:     <secmodel>
Aug 26 17:35:53 user nova-compute[73110]:       <model>dac</model>
Aug 26 17:35:53 user nova-compute[73110]:       <doi>0</doi>
Aug 26 17:35:53 user nova-compute[73110]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 17:35:53 user nova-compute[73110]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 17:35:53 user nova-compute[73110]:     </secmodel>
Aug 26 17:35:53 user nova-compute[73110]:   </host>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='alpha'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>clipper</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='armv6l'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>spitz</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>nuri</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>kzm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>z2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>tosa</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n810</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>terrier</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>midway</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>microbit</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>verdex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>highbank</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>akita</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>connex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>collie</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='armv7l'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>spitz</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>nuri</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>kzm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>z2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>tosa</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n810</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>terrier</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>midway</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>microbit</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>verdex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>highbank</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>akita</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>connex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>collie</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='aarch64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>spitz</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>nuri</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>kzm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>z2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>tosa</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n810</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>n800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>terrier</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>midway</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>microbit</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>verdex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>highbank</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>akita</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>connex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>collie</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <acpi default='on' toggle='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='cris'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='i686'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>isapc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>microvm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='kvm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <pae/>
Aug 26 17:35:53 user nova-compute[73110]:       <nonpae/>
Aug 26 17:35:53 user nova-compute[73110]:       <acpi default='on' toggle='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:       <apic default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='m68k'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>an5206</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>q800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='microblaze'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='microblazeel'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='mips'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>malta</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='mipsel'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>malta</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='mips64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>malta</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>pica61</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>magnum</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='mips64el'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>malta</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>pica61</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>magnum</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='16'>boston</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='ppc'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mac99</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>40p</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>taihu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='ppc64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>taihu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>40p</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mac99</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='ppc64le'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>taihu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>40p</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>mac99</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='riscv32'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='8'>spike</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='8'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='riscv64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='8'>spike</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='8'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='s390x'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='sh4'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>shix</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>r2d</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='sh4eb'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>shix</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>r2d</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='sparc'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>LX</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='sparc64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>niagara</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='x86_64'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>64</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='1'>isapc</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>microvm</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='kvm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <acpi default='on' toggle='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:       <apic default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='xtensa'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>sim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>kc705</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ml605</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx200</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx60</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]:   <guest>
Aug 26 17:35:53 user nova-compute[73110]:     <os_type>hvm</os_type>
Aug 26 17:35:53 user nova-compute[73110]:     <arch name='xtensaeb'>
Aug 26 17:35:53 user nova-compute[73110]:       <wordsize>32</wordsize>
Aug 26 17:35:53 user nova-compute[73110]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='4'>sim</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>kc705</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ml605</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>virt</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx200</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>lx60</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 17:35:53 user nova-compute[73110]:       <domain type='qemu'/>
Aug 26 17:35:53 user nova-compute[73110]:     </arch>
Aug 26 17:35:53 user nova-compute[73110]:     <features>
Aug 26 17:35:53 user nova-compute[73110]:       <cpuselection/>
Aug 26 17:35:53 user nova-compute[73110]:       <deviceboot/>
Aug 26 17:35:53 user nova-compute[73110]:       <disksnapshot default='on' toggle='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     </features>
Aug 26 17:35:53 user nova-compute[73110]:   </guest>
Aug 26 17:35:53 user nova-compute[73110]: </capabilities>
Aug 26 17:35:53 user nova-compute[73110]: 
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-i440fx-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>i686</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='255'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'/>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='lm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ide</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-q35-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>i686</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='288'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'/>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='lm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-i440fx-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>i686</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='255'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'/>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='lm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ide</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-q35-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>i686</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='288'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'/>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='lm'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-i440fx-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>x86_64</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='255'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>efi</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='invtsc'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='rsba'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ide</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-q35-jammy</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>x86_64</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='288'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>efi</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='invtsc'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='rsba'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-i440fx-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>x86_64</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='255'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>efi</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='invtsc'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='rsba'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ide</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 17:35:53 user nova-compute[73110]: <domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 17:35:53 user nova-compute[73110]:   <domain>kvm</domain>
Aug 26 17:35:53 user nova-compute[73110]:   <machine>pc-q35-6.2</machine>
Aug 26 17:35:53 user nova-compute[73110]:   <arch>x86_64</arch>
Aug 26 17:35:53 user nova-compute[73110]:   <vcpu max='288'/>
Aug 26 17:35:53 user nova-compute[73110]:   <iothreads supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:   <os supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='firmware'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>efi</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:     <loader supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>rom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pflash</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='readonly'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='secure'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>yes</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>no</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </loader>
Aug 26 17:35:53 user nova-compute[73110]:   </os>
Aug 26 17:35:53 user nova-compute[73110]:   <cpu>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-passthrough' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='hostPassthroughMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='maximum' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='maximumMigratable'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>on</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>off</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='host-model' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <vendor>Intel</vendor>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ss'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='vmx'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pcid'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='hypervisor'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arat'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='umip'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='md-clear'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='invtsc'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibpb'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='ibrs'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-stibp'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='rsba'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='erms'/>
Aug 26 17:35:53 user nova-compute[73110]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:     <mode name='custom' supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>qemu64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>qemu32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>phenom</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>pentium</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>n270</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm64</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>kvm32</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>coreduo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>core2duo</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>athlon</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Westmere</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Snowridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Skylake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>SandyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Penryn</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G5</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G4</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G3</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Opteron_G2</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Opteron_G1</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>IvyBridge</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Icelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Haswell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Rome</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-Milan</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>EPYC</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Dhyana</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cooperlake</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>Conroe</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='no'>Broadwell</model>
Aug 26 17:35:53 user nova-compute[73110]:       <model usable='yes'>486</model>
Aug 26 17:35:53 user nova-compute[73110]:     </mode>
Aug 26 17:35:53 user nova-compute[73110]:   </cpu>
Aug 26 17:35:53 user nova-compute[73110]:   <memoryBacking supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:     <enum name='sourceType'>
Aug 26 17:35:53 user nova-compute[73110]:       <value>file</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>anonymous</value>
Aug 26 17:35:53 user nova-compute[73110]:       <value>memfd</value>
Aug 26 17:35:53 user nova-compute[73110]:     </enum>
Aug 26 17:35:53 user nova-compute[73110]:   </memoryBacking>
Aug 26 17:35:53 user nova-compute[73110]:   <devices>
Aug 26 17:35:53 user nova-compute[73110]:     <disk supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='diskDevice'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>disk</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cdrom</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>floppy</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>lun</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='bus'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>fdc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sata</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </disk>
Aug 26 17:35:53 user nova-compute[73110]:     <graphics supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='type'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>sdl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vnc</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>spice</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egl-headless</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </graphics>
Aug 26 17:35:53 user nova-compute[73110]:     <video supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='modelType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>cirrus</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>vmvga</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>qxl</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>none</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>bochs</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>ramfb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </video>
Aug 26 17:35:53 user nova-compute[73110]:     <hostdev supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='mode'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>subsystem</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='startupPolicy'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>default</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>mandatory</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>requisite</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>optional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='subsysType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>usb</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>pci</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>scsi</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='capsType'/>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='pciBackend'/>
Aug 26 17:35:53 user nova-compute[73110]:     </hostdev>
Aug 26 17:35:53 user nova-compute[73110]:     <rng supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtio-non-transitional</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>random</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>egd</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>builtin</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </rng>
Aug 26 17:35:53 user nova-compute[73110]:     <filesystem supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='driverType'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>path</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>handle</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>virtiofs</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </filesystem>
Aug 26 17:35:53 user nova-compute[73110]:     <tpm supported='yes'>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='model'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-tis</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>tpm-crb</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:       <enum name='backendModel'>
Aug 26 17:35:53 user nova-compute[73110]:         <value>passthrough</value>
Aug 26 17:35:53 user nova-compute[73110]:         <value>emulator</value>
Aug 26 17:35:53 user nova-compute[73110]:       </enum>
Aug 26 17:35:53 user nova-compute[73110]:     </tpm>
Aug 26 17:35:53 user nova-compute[73110]:   </devices>
Aug 26 17:35:53 user nova-compute[73110]:   <features>
Aug 26 17:35:53 user nova-compute[73110]:     <gic supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:     <vmcoreinfo supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <genid supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backingStoreInput supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <backup supported='yes'/>
Aug 26 17:35:53 user nova-compute[73110]:     <sev supported='no'/>
Aug 26 17:35:53 user nova-compute[73110]:   </features>
Aug 26 17:35:53 user nova-compute[73110]: </domainCapabilities>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73110) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73110) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Checking secure boot support for host arch (x86_64) {{(pid=73110) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Checking secure boot support for host arch (x86_64) {{(pid=73110) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Checking secure boot support for host arch (x86_64) {{(pid=73110) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Secure Boot support detected
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] cpu compare xml: <cpu match="exact">
Aug 26 17:35:53 user nova-compute[73110]:   <model>Nehalem</model>
Aug 26 17:35:53 user nova-compute[73110]: </cpu>
Aug 26 17:35:53 user nova-compute[73110]:  {{(pid=73110) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.virt.node [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Generated node identity 166b0a1a-be79-4fde-8303-88dbbf28dbea
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.virt.node [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Wrote node identity 166b0a1a-be79-4fde-8303-88dbbf28dbea to /opt/stack/data/nova/compute_id
Aug 26 17:35:53 user nova-compute[73110]: WARNING nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Compute nodes ['166b0a1a-be79-4fde-8303-88dbbf28dbea'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 17:35:53 user nova-compute[73110]: WARNING nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 17:35:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:35:53 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:35:53 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Hypervisor/Node resource view: name=user free_ram=10865MB free_disk=26.233070373535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:35:53 user nova-compute[73110]: WARNING nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] No compute node record for user:166b0a1a-be79-4fde-8303-88dbbf28dbea: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 166b0a1a-be79-4fde-8303-88dbbf28dbea could not be found.
Aug 26 17:35:53 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Compute node record created for user:user with uuid: 166b0a1a-be79-4fde-8303-88dbbf28dbea
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:35:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:35:54 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [req-0ad36638-e46e-4bfe-a15f-8e6895f89912] Created resource provider record via placement API for resource provider with UUID 166b0a1a-be79-4fde-8303-88dbbf28dbea and name user.
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73110) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 17:35:54 user nova-compute[73110]: INFO nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] kernel doesn't support AMD SEV
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Libvirt baseline CPU <cpu>
Aug 26 17:35:54 user nova-compute[73110]:   <arch>x86_64</arch>
Aug 26 17:35:54 user nova-compute[73110]:   <model>Nehalem</model>
Aug 26 17:35:54 user nova-compute[73110]:   <vendor>Intel</vendor>
Aug 26 17:35:54 user nova-compute[73110]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 17:35:54 user nova-compute[73110]: </cpu>
Aug 26 17:35:54 user nova-compute[73110]:  {{(pid=73110) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Updated inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Updating resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea generation from 0 to 1 during operation: update_inventory {{(pid=73110) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Updating resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea generation from 1 to 2 during operation: update_traits {{(pid=73110) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.service [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Creating RPC server for service compute {{(pid=73110) start /opt/stack/nova/nova/service.py:182}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.service [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Join ServiceGroup membership for this service compute {{(pid=73110) start /opt/stack/nova/nova/service.py:199}}
Aug 26 17:35:54 user nova-compute[73110]: DEBUG nova.servicegroup.drivers.db [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73110) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 17:36:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:36:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:36:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.13677978515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:36:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:37:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:37:46 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:37:46 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=10193MB free_disk=26.183242797851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:37:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:37:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:37:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:38:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:38:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:38:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:38:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:38:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=10159MB free_disk=25.967037200927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:38:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:39:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:39:50 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:39:50 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=9476MB free_disk=25.989933013916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:39:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:39:59 user nova-compute[73110]: INFO nova.compute.claims [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Claim successful on node user
Aug 26 17:39:59 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:39:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:00 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:00 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Creating image(s)
Aug 26 17:40:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "/opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "/opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "/opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:00 user nova-compute[73110]: DEBUG nova.policy [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b90228eb1a2f45a5a618ddf8235f528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5453ee9efa446ac99e294561ec2f170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.part --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG nova.virt.images [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] 4299a158-616a-46c3-b665-9d8a5d47a509 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.part /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.part /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.converted" returned: 0 in 0.338s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:01 user nova-compute[73110]: INFO nova.compute.claims [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Claim successful on node user
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.588s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:02 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpouz9mqrs/privsep.sock']
Aug 26 17:40:02 user sudo[82393]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpouz9mqrs/privsep.sock
Aug 26 17:40:02 user sudo[82393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Creating image(s)
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:02 user nova-compute[73110]: INFO nova.compute.claims [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Claim successful on node user
Aug 26 17:40:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Successfully created port: ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.policy [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c351654543af4a9a86d72d041fcaacb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8688c8465f324c4a9196980792b35718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Creating image(s)
Aug 26 17:40:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:04 user sudo[82393]: pam_unix(sudo:session): session closed for user root
Aug 26 17:40:04 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Spawned new privsep daemon via rootwrap
Aug 26 17:40:04 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 17:40:04 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 17:40:04 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 17:40:04 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82400
Aug 26 17:40:04 user nova-compute[73110]: WARNING oslo_privsep.priv_context [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] privsep daemon already running
Aug 26 17:40:04 user nova-compute[73110]: WARNING oslo_privsep.priv_context [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] privsep daemon already running
Aug 26 17:40:04 user nova-compute[73110]: DEBUG nova.policy [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72e7c15b85554d30915b4957791d2d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed9258ba923464ba423b3b9751f56cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.218s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.241s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk 1073741824" returned: 0 in 0.043s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.222s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.169s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk 1073741824" returned: 0 in 0.048s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.484s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Cannot resize image /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Ensure instance console log exists: /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.164s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk 1073741824" returned: 0 in 0.061s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Cannot resize image /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Ensure instance console log exists: /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Cannot resize image /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Ensure instance console log exists: /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Successfully created port: b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Successfully updated port: ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquired lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-changed-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Refreshing instance network info cache due to event network-changed-ed8e9322-db71-4892-b133-e74dcbe2968a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] Acquiring lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Successfully created port: bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:07 user nova-compute[73110]: INFO nova.compute.claims [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Claim successful on node user
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.neutron [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updating instance_info_cache with network_info: [{"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Releasing lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Instance network_info: |[{"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] Acquired lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Refreshing network info cache for port ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Start _get_guest_xml network_info=[{"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:08 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:08 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-798306127',display_name='tempest-DeleteServersTestJSON-server-798306127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-798306127',id=1,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5453ee9efa446ac99e294561ec2f170',ramdisk_id='',reservation_id='r-3ews8z13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-618857684',owner_user_name='tempest-DeleteServersTestJSON-618857684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:00Z,user_data=None,user_id='b90228eb1a2f45a5a618ddf8235f528d',uuid=c66c6639-1168-477d-9f15-30e31cbb2369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converting VIF {"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.objects.instance [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lazy-loading 'pci_devices' on Instance uuid c66c6639-1168-477d-9f15-30e31cbb2369 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:08 user nova-compute[73110]:   <uuid>c66c6639-1168-477d-9f15-30e31cbb2369</uuid>
Aug 26 17:40:08 user nova-compute[73110]:   <name>instance-00000001</name>
Aug 26 17:40:08 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:08 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:08 user nova-compute[73110]:   <metadata>
Aug 26 17:40:08 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:08 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:name>tempest-DeleteServersTestJSON-server-798306127</nova:name>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:08</nova:creationTime>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:08 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:08 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:user uuid="b90228eb1a2f45a5a618ddf8235f528d">tempest-DeleteServersTestJSON-618857684-project-member</nova:user>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:project uuid="f5453ee9efa446ac99e294561ec2f170">tempest-DeleteServersTestJSON-618857684</nova:project>
Aug 26 17:40:08 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:08 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:08 user nova-compute[73110]:         <nova:port uuid="ed8e9322-db71-4892-b133-e74dcbe2968a">
Aug 26 17:40:08 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 17:40:08 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:08 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:08 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:08 user nova-compute[73110]:   </metadata>
Aug 26 17:40:08 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:08 user nova-compute[73110]:     <system>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="serial">c66c6639-1168-477d-9f15-30e31cbb2369</entry>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="uuid">c66c6639-1168-477d-9f15-30e31cbb2369</entry>
Aug 26 17:40:08 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:08 user nova-compute[73110]:     </system>
Aug 26 17:40:08 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:08 user nova-compute[73110]:   <os>
Aug 26 17:40:08 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:08 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:08 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:08 user nova-compute[73110]:   </os>
Aug 26 17:40:08 user nova-compute[73110]:   <features>
Aug 26 17:40:08 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:08 user nova-compute[73110]:     <apic/>
Aug 26 17:40:08 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:08 user nova-compute[73110]:   </features>
Aug 26 17:40:08 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:08 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:08 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:08 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:08 user nova-compute[73110]:   </clock>
Aug 26 17:40:08 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:08 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:08 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:08 user nova-compute[73110]:   </cpu>
Aug 26 17:40:08 user nova-compute[73110]:   <devices>
Aug 26 17:40:08 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:08 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:08 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk"/>
Aug 26 17:40:08 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:08 user nova-compute[73110]:     </disk>
Aug 26 17:40:08 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:08 user nova-compute[73110]:       <mac address="fa:16:3e:b6:49:4f"/>
Aug 26 17:40:08 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:08 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:08 user nova-compute[73110]:       <target dev="taped8e9322-db"/>
Aug 26 17:40:08 user nova-compute[73110]:     </interface>
Aug 26 17:40:08 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:08 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/console.log" append="off"/>
Aug 26 17:40:08 user nova-compute[73110]:     </serial>
Aug 26 17:40:08 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:08 user nova-compute[73110]:     <video>
Aug 26 17:40:08 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:08 user nova-compute[73110]:     </video>
Aug 26 17:40:08 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:08 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:08 user nova-compute[73110]:     </rng>
Aug 26 17:40:08 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:08 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:08 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:08 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:08 user nova-compute[73110]:   </devices>
Aug 26 17:40:08 user nova-compute[73110]: </domain>
Aug 26 17:40:08 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-798306127',display_name='tempest-DeleteServersTestJSON-server-798306127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-798306127',id=1,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5453ee9efa446ac99e294561ec2f170',ramdisk_id='',reservation_id='r-3ews8z13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-618857684',owner_user_name='tempest-DeleteServersTestJSON-618857684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:00Z,user_data=None,user_id='b90228eb1a2f45a5a618ddf8235f528d',uuid=c66c6639-1168-477d-9f15-30e31cbb2369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converting VIF {"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG os_vif [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Creating image(s)
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Created schema index Interface.name {{(pid=73110) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Created schema index Port.name {{(pid=73110) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Created schema index Bridge.name {{(pid=73110) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [POLLOUT] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:08 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjg6hf1f8/privsep.sock']
Aug 26 17:40:08 user sudo[82454]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjg6hf1f8/privsep.sock
Aug 26 17:40:08 user sudo[82454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG nova.policy [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '952334e4f9ae44ba841a0b8f200a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '698cfee557244870b583fadf02e52a69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk 1073741824" returned: 0 in 0.049s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.170s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Cannot resize image /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Ensure instance console log exists: /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Successfully updated port: b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updated VIF entry in instance network info cache for port ed8e9322-db71-4892-b133-e74dcbe2968a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updating instance_info_cache with network_info: [{"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ce86507-b03d-4e64-9a2b-11084b42efa6 req-d84d90c0-62c3-4fde-8e51-f727266ef58a service nova] Releasing lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:10 user sudo[82454]: pam_unix(sudo:session): session closed for user root
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:10 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Spawned new privsep daemon via rootwrap
Aug 26 17:40:10 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 17:40:10 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 17:40:10 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 17:40:10 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82471
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:10 user nova-compute[73110]: INFO nova.compute.claims [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Claim successful on node user
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-changed-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing instance network info cache due to event network-changed-b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Successfully updated port: bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Creating image(s)
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Successfully created port: 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped8e9322-db, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped8e9322-db, col_values=(('external_ids', {'iface-id': 'ed8e9322-db71-4892-b133-e74dcbe2968a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:49:4f', 'vm-uuid': 'c66c6639-1168-477d-9f15-30e31cbb2369'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:11 user nova-compute[73110]: INFO os_vif [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db')
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.policy [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65b8f68535c94d32b9178427f2654db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ce94322c8d42b5a3dbd2af9e84c263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] No VIF found with MAC fa:16:3e:b6:49:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Instance network_info: |[{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing network info cache for port b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Start _get_guest_xml network_info=[{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk 1073741824" returned: 0 in 0.064s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-801884025',display_name='tempest-ServerActionsTestOtherA-server-801884025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-801884025',id=2,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-zl3906y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=2e75e82b-9455-411f-92e0-e9b831f23a34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.objects.instance [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:11 user nova-compute[73110]:   <uuid>2e75e82b-9455-411f-92e0-e9b831f23a34</uuid>
Aug 26 17:40:11 user nova-compute[73110]:   <name>instance-00000002</name>
Aug 26 17:40:11 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:11 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:11 user nova-compute[73110]:   <metadata>
Aug 26 17:40:11 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:11 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherA-server-801884025</nova:name>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:11</nova:creationTime>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:11 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:11 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:user uuid="c351654543af4a9a86d72d041fcaacb4">tempest-ServerActionsTestOtherA-1020251450-project-member</nova:user>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:project uuid="8688c8465f324c4a9196980792b35718">tempest-ServerActionsTestOtherA-1020251450</nova:project>
Aug 26 17:40:11 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:11 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:11 user nova-compute[73110]:         <nova:port uuid="b8616500-11c9-4ea0-a472-839831230b20">
Aug 26 17:40:11 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 17:40:11 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:11 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:11 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:11 user nova-compute[73110]:   </metadata>
Aug 26 17:40:11 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:11 user nova-compute[73110]:     <system>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="serial">2e75e82b-9455-411f-92e0-e9b831f23a34</entry>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="uuid">2e75e82b-9455-411f-92e0-e9b831f23a34</entry>
Aug 26 17:40:11 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:11 user nova-compute[73110]:     </system>
Aug 26 17:40:11 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:11 user nova-compute[73110]:   <os>
Aug 26 17:40:11 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:11 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:11 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:11 user nova-compute[73110]:   </os>
Aug 26 17:40:11 user nova-compute[73110]:   <features>
Aug 26 17:40:11 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:11 user nova-compute[73110]:     <apic/>
Aug 26 17:40:11 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:11 user nova-compute[73110]:   </features>
Aug 26 17:40:11 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:11 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:11 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:11 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:11 user nova-compute[73110]:   </clock>
Aug 26 17:40:11 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:11 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:11 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:11 user nova-compute[73110]:   </cpu>
Aug 26 17:40:11 user nova-compute[73110]:   <devices>
Aug 26 17:40:11 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:11 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:11 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk"/>
Aug 26 17:40:11 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:11 user nova-compute[73110]:     </disk>
Aug 26 17:40:11 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:11 user nova-compute[73110]:       <mac address="fa:16:3e:ef:14:59"/>
Aug 26 17:40:11 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:11 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:11 user nova-compute[73110]:       <target dev="tapb8616500-11"/>
Aug 26 17:40:11 user nova-compute[73110]:     </interface>
Aug 26 17:40:11 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:11 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/console.log" append="off"/>
Aug 26 17:40:11 user nova-compute[73110]:     </serial>
Aug 26 17:40:11 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:11 user nova-compute[73110]:     <video>
Aug 26 17:40:11 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:11 user nova-compute[73110]:     </video>
Aug 26 17:40:11 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:11 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:11 user nova-compute[73110]:     </rng>
Aug 26 17:40:11 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:11 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:11 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:11 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:11 user nova-compute[73110]:   </devices>
Aug 26 17:40:11 user nova-compute[73110]: </domain>
Aug 26 17:40:11 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-801884025',display_name='tempest-ServerActionsTestOtherA-server-801884025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-801884025',id=2,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-zl3906y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=2e75e82b-9455-411f-92e0-e9b831f23a34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG os_vif [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8616500-11, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8616500-11, col_values=(('external_ids', {'iface-id': 'b8616500-11c9-4ea0-a472-839831230b20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:14:59', 'vm-uuid': '2e75e82b-9455-411f-92e0-e9b831f23a34'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.263s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:12 user nova-compute[73110]: INFO os_vif [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11')
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Cannot resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Ensure instance console log exists: /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:ef:14:59, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance network_info: |[{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start _get_guest_xml network_info=[{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:12 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:12 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'pci_devices' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:12 user nova-compute[73110]:   <uuid>84d42b86-03a9-496c-85bd-e643ea8ab023</uuid>
Aug 26 17:40:12 user nova-compute[73110]:   <name>instance-00000003</name>
Aug 26 17:40:12 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:12 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:12 user nova-compute[73110]:   <metadata>
Aug 26 17:40:12 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:12 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherB-server-332987352</nova:name>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:12</nova:creationTime>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:12 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:12 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:user uuid="72e7c15b85554d30915b4957791d2d54">tempest-ServerActionsTestOtherB-453496732-project-member</nova:user>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:project uuid="aed9258ba923464ba423b3b9751f56cc">tempest-ServerActionsTestOtherB-453496732</nova:project>
Aug 26 17:40:12 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:12 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:12 user nova-compute[73110]:         <nova:port uuid="bc99d4df-9d70-45f8-ba11-6965e6f146dc">
Aug 26 17:40:12 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:40:12 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:12 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:12 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:12 user nova-compute[73110]:   </metadata>
Aug 26 17:40:12 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:12 user nova-compute[73110]:     <system>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="serial">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="uuid">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:40:12 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:12 user nova-compute[73110]:     </system>
Aug 26 17:40:12 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:12 user nova-compute[73110]:   <os>
Aug 26 17:40:12 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:12 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:12 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:12 user nova-compute[73110]:   </os>
Aug 26 17:40:12 user nova-compute[73110]:   <features>
Aug 26 17:40:12 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:12 user nova-compute[73110]:     <apic/>
Aug 26 17:40:12 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:12 user nova-compute[73110]:   </features>
Aug 26 17:40:12 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:12 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:12 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:12 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:12 user nova-compute[73110]:   </clock>
Aug 26 17:40:12 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:12 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:12 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:12 user nova-compute[73110]:   </cpu>
Aug 26 17:40:12 user nova-compute[73110]:   <devices>
Aug 26 17:40:12 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:12 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:12 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk"/>
Aug 26 17:40:12 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:12 user nova-compute[73110]:     </disk>
Aug 26 17:40:12 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:12 user nova-compute[73110]:       <mac address="fa:16:3e:58:9f:3c"/>
Aug 26 17:40:12 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:12 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:12 user nova-compute[73110]:       <target dev="tapbc99d4df-9d"/>
Aug 26 17:40:12 user nova-compute[73110]:     </interface>
Aug 26 17:40:12 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:12 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/console.log" append="off"/>
Aug 26 17:40:12 user nova-compute[73110]:     </serial>
Aug 26 17:40:12 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:12 user nova-compute[73110]:     <video>
Aug 26 17:40:12 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:12 user nova-compute[73110]:     </video>
Aug 26 17:40:12 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:12 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:12 user nova-compute[73110]:     </rng>
Aug 26 17:40:12 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:12 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:12 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:12 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:12 user nova-compute[73110]:   </devices>
Aug 26 17:40:12 user nova-compute[73110]: </domain>
Aug 26 17:40:12 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG os_vif [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc99d4df-9d, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc99d4df-9d, col_values=(('external_ids', {'iface-id': 'bc99d4df-9d70-45f8-ba11-6965e6f146dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:9f:3c', 'vm-uuid': '84d42b86-03a9-496c-85bd-e643ea8ab023'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:12 user nova-compute[73110]: INFO os_vif [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No VIF found with MAC fa:16:3e:58:9f:3c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-changed-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Refreshing instance network info cache due to event network-changed-bc99d4df-9d70-45f8-ba11-6965e6f146dc. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Refreshing network info cache for port bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated VIF entry in instance network info cache for port b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-899fd350-3678-4d03-b8cf-caa2cf0980a2 req-0a80ab42-eb62-402b-b921-d6905e6b6403 service nova] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Successfully created port: df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updated VIF entry in instance network info cache for port bc99d4df-9d70-45f8-ba11-6965e6f146dc. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58e50780-7c5f-4657-a241-daac19595721 req-fef3ef98-ebf1-47be-b856-9cd95324d80a service nova] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Successfully updated port: 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing instance network info cache due to event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance network_info: |[{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.neutron [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start _get_guest_xml network_info=[{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:16 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:16 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-888669765',display_name='tempest-ServerStableDeviceRescueTest-server-888669765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-888669765',id=4,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbuFk+K1pxZR9a4QvkWecbUi3JuCbGRz7lFcJX3ParM12ZMFodvkAui0Sq9NhYW1f+r5L73YYv1YVCMiB80dvvwaNpeAm9ThsOnzEsXu6/7/ENeE7J5wD/bjJwTv4BBQ==',key_name='tempest-keypair-38390506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698cfee557244870b583fadf02e52a69',ramdisk_id='',reservation_id='r-pamlg4rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-281478421',owner_user_name='tempest-ServerStableDeviceRescueTest-281478421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952334e4f9ae44ba841a0b8f200a56ea',uuid=2207fd05-7b0c-4b99-bad7-46c1707ec1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converting VIF {"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.objects.instance [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'pci_devices' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:16 user nova-compute[73110]:   <uuid>2207fd05-7b0c-4b99-bad7-46c1707ec1bc</uuid>
Aug 26 17:40:16 user nova-compute[73110]:   <name>instance-00000004</name>
Aug 26 17:40:16 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:16 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:16 user nova-compute[73110]:   <metadata>
Aug 26 17:40:16 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:16 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-888669765</nova:name>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:16</nova:creationTime>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:16 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:16 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:user uuid="952334e4f9ae44ba841a0b8f200a56ea">tempest-ServerStableDeviceRescueTest-281478421-project-member</nova:user>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:project uuid="698cfee557244870b583fadf02e52a69">tempest-ServerStableDeviceRescueTest-281478421</nova:project>
Aug 26 17:40:16 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:16 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:16 user nova-compute[73110]:         <nova:port uuid="215e0790-c265-4add-b5be-a21efa2c1bd4">
Aug 26 17:40:16 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:40:16 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:16 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:16 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:16 user nova-compute[73110]:   </metadata>
Aug 26 17:40:16 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:16 user nova-compute[73110]:     <system>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="serial">2207fd05-7b0c-4b99-bad7-46c1707ec1bc</entry>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="uuid">2207fd05-7b0c-4b99-bad7-46c1707ec1bc</entry>
Aug 26 17:40:16 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:16 user nova-compute[73110]:     </system>
Aug 26 17:40:16 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:16 user nova-compute[73110]:   <os>
Aug 26 17:40:16 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:16 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:16 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:16 user nova-compute[73110]:   </os>
Aug 26 17:40:16 user nova-compute[73110]:   <features>
Aug 26 17:40:16 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:16 user nova-compute[73110]:     <apic/>
Aug 26 17:40:16 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:16 user nova-compute[73110]:   </features>
Aug 26 17:40:16 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:16 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:16 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:16 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:16 user nova-compute[73110]:   </clock>
Aug 26 17:40:16 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:16 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:16 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:16 user nova-compute[73110]:   </cpu>
Aug 26 17:40:16 user nova-compute[73110]:   <devices>
Aug 26 17:40:16 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:16 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:16 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk"/>
Aug 26 17:40:16 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:16 user nova-compute[73110]:     </disk>
Aug 26 17:40:16 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:16 user nova-compute[73110]:       <mac address="fa:16:3e:3f:73:c7"/>
Aug 26 17:40:16 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:16 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:16 user nova-compute[73110]:       <target dev="tap215e0790-c2"/>
Aug 26 17:40:16 user nova-compute[73110]:     </interface>
Aug 26 17:40:16 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:16 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/console.log" append="off"/>
Aug 26 17:40:16 user nova-compute[73110]:     </serial>
Aug 26 17:40:16 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:16 user nova-compute[73110]:     <video>
Aug 26 17:40:16 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:16 user nova-compute[73110]:     </video>
Aug 26 17:40:16 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:16 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:16 user nova-compute[73110]:     </rng>
Aug 26 17:40:16 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:16 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:16 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:16 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:16 user nova-compute[73110]:   </devices>
Aug 26 17:40:16 user nova-compute[73110]: </domain>
Aug 26 17:40:16 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-888669765',display_name='tempest-ServerStableDeviceRescueTest-server-888669765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-888669765',id=4,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbuFk+K1pxZR9a4QvkWecbUi3JuCbGRz7lFcJX3ParM12ZMFodvkAui0Sq9NhYW1f+r5L73YYv1YVCMiB80dvvwaNpeAm9ThsOnzEsXu6/7/ENeE7J5wD/bjJwTv4BBQ==',key_name='tempest-keypair-38390506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698cfee557244870b583fadf02e52a69',ramdisk_id='',reservation_id='r-pamlg4rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-281478421',owner_user_name='tempest-ServerStableDeviceRescueTest-281478421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952334e4f9ae44ba841a0b8f200a56ea',uuid=2207fd05-7b0c-4b99-bad7-46c1707ec1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converting VIF {"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG os_vif [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap215e0790-c2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap215e0790-c2, col_values=(('external_ids', {'iface-id': '215e0790-c265-4add-b5be-a21efa2c1bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:73:c7', 'vm-uuid': '2207fd05-7b0c-4b99-bad7-46c1707ec1bc'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:16 user nova-compute[73110]: INFO os_vif [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2')
Aug 26 17:40:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No VIF found with MAC fa:16:3e:3f:73:c7, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Successfully updated port: df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-changed-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Refreshing instance network info cache due to event network-changed-df549c20-9f92-4f6a-8ba4-90a7ea5605d0. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.0428762, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Resumed (Lifecycle Event)
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance spawned successfully.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Instance spawned successfully.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Instance spawned successfully.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.0529816, 2e75e82b-9455-411f-92e0-e9b831f23a34 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] VM Resumed (Lifecycle Event)
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updated VIF entry in instance network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-18a90f19-f7ec-47a7-9d96-ca72d2d149eb req-a0e7ac9c-4199-415b-8697-9263b36c88cb service nova] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Took 14.82 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Took 15.89 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Took 18.07 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.054556, c66c6639-1168-477d-9f15-30e31cbb2369 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] VM Resumed (Lifecycle Event)
Aug 26 17:40:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Took 17.01 seconds to build instance.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.0547836, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Started (Lifecycle Event)
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf8a846-c0ff-4690-b8db-ef16205163bc tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.303s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Took 19.27 seconds to build instance.
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Took 16.25 seconds to build instance.
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9d4a985d-4da3-4e98-ae9d-1df6a140d703 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.508s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8bface49-8a53-4874-9b17-cc2207ab7871 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.435s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.0549645, c66c6639-1168-477d-9f15-30e31cbb2369 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] VM Started (Lifecycle Event)
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071618.0589912, 2e75e82b-9455-411f-92e0-e9b831f23a34 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] VM Started (Lifecycle Event)
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance network_info: |[{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.neutron [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Refreshing network info cache for port df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start _get_guest_xml network_info=[{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.objects.instance [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:19 user nova-compute[73110]:   <uuid>7a5294e5-ba09-49bd-b78a-33ebc306d925</uuid>
Aug 26 17:40:19 user nova-compute[73110]:   <name>instance-00000005</name>
Aug 26 17:40:19 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:19 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:19 user nova-compute[73110]:   <metadata>
Aug 26 17:40:19 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:19 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeTestJSON-server-934297327</nova:name>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:19</nova:creationTime>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:19 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:19 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:user uuid="65b8f68535c94d32b9178427f2654db8">tempest-AttachVolumeTestJSON-1129991883-project-member</nova:user>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:project uuid="38ce94322c8d42b5a3dbd2af9e84c263">tempest-AttachVolumeTestJSON-1129991883</nova:project>
Aug 26 17:40:19 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:19 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:19 user nova-compute[73110]:         <nova:port uuid="df549c20-9f92-4f6a-8ba4-90a7ea5605d0">
Aug 26 17:40:19 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 17:40:19 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:19 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:19 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:19 user nova-compute[73110]:   </metadata>
Aug 26 17:40:19 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:19 user nova-compute[73110]:     <system>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="serial">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="uuid">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:40:19 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:19 user nova-compute[73110]:     </system>
Aug 26 17:40:19 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:19 user nova-compute[73110]:   <os>
Aug 26 17:40:19 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:19 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:19 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:19 user nova-compute[73110]:   </os>
Aug 26 17:40:19 user nova-compute[73110]:   <features>
Aug 26 17:40:19 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:19 user nova-compute[73110]:     <apic/>
Aug 26 17:40:19 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:19 user nova-compute[73110]:   </features>
Aug 26 17:40:19 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:19 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:19 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:19 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:19 user nova-compute[73110]:   </clock>
Aug 26 17:40:19 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:19 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:19 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:19 user nova-compute[73110]:   </cpu>
Aug 26 17:40:19 user nova-compute[73110]:   <devices>
Aug 26 17:40:19 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:19 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:19 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk"/>
Aug 26 17:40:19 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:19 user nova-compute[73110]:     </disk>
Aug 26 17:40:19 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:19 user nova-compute[73110]:       <mac address="fa:16:3e:ee:a0:36"/>
Aug 26 17:40:19 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:19 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:19 user nova-compute[73110]:       <target dev="tapdf549c20-9f"/>
Aug 26 17:40:19 user nova-compute[73110]:     </interface>
Aug 26 17:40:19 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:19 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/console.log" append="off"/>
Aug 26 17:40:19 user nova-compute[73110]:     </serial>
Aug 26 17:40:19 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:19 user nova-compute[73110]:     <video>
Aug 26 17:40:19 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:19 user nova-compute[73110]:     </video>
Aug 26 17:40:19 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:19 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:19 user nova-compute[73110]:     </rng>
Aug 26 17:40:19 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:19 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:19 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:19 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:19 user nova-compute[73110]:   </devices>
Aug 26 17:40:19 user nova-compute[73110]: </domain>
Aug 26 17:40:19 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG os_vif [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf549c20-9f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf549c20-9f, col_values=(('external_ids', {'iface-id': 'df549c20-9f92-4f6a-8ba4-90a7ea5605d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:a0:36', 'vm-uuid': '7a5294e5-ba09-49bd-b78a-33ebc306d925'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: INFO os_vif [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No VIF found with MAC fa:16:3e:ee:a0:36, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updated VIF entry in instance network info cache for port df549c20-9f92-4f6a-8ba4-90a7ea5605d0. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f059f3bb-84df-4989-a5c5-6b75aa984a3b req-0e43d93e-92b0-4d31-a93a-855359fbc478 service nova] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071622.2936385, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Resumed (Lifecycle Event)
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance spawned successfully.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071622.2953303, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Started (Lifecycle Event)
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Took 13.97 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] No waiting events found dispatching network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:22 user nova-compute[73110]: WARNING nova.compute.manager [req-ee91584d-6192-4dd6-bcc3-24afe3b3d40f req-45ecb2ae-a37b-4efb-9a83-06c672f22760 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received unexpected event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a for instance with vm_state active and task_state None.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: INFO nova.compute.manager [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Took 14.90 seconds to build instance.
Aug 26 17:40:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-585a7e25-913d-4c2f-94bd-f7d09f901ad3 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.043s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071624.5166793, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Resumed (Lifecycle Event)
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance spawned successfully.
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071624.5167966, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Started (Lifecycle Event)
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Took 13.47 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] No waiting events found dispatching network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:24 user nova-compute[73110]: WARNING nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received unexpected event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a for instance with vm_state active and task_state None.
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:24 user nova-compute[73110]: WARNING nova.compute.manager [req-d0d4bb28-3faf-4697-88d6-9f92b2c65f22 req-751d6284-afe8-4c44-9d1e-bbbad4d0c939 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state None.
Aug 26 17:40:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:25 user nova-compute[73110]: INFO nova.compute.manager [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Took 14.38 seconds to build instance.
Aug 26 17:40:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-59f8bf94-1ff1-4d19-a8a8-0c232cb9f835 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.511s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:26 user nova-compute[73110]: WARNING nova.compute.manager [req-bdb4b1dd-bc8a-48e2-8705-e253bd089604 req-da04c187-5fd2-47e9-8923-9b465ff1a15c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state None.
Aug 26 17:40:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:28 user nova-compute[73110]: INFO nova.compute.claims [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Claim successful on node user
Aug 26 17:40:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:29 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Creating image(s)
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "/opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "/opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "/opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG nova.policy [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07467ef74ea34f21949b8a00da319315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88799fc21bb642ecb30f13d1b9ba20d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.291s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.255s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk 1073741824" returned: 0 in 0.167s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.532s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Successfully created port: 5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.369s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Cannot resize image /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Ensure instance console log exists: /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Successfully updated port: 5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquired lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-changed-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Refreshing instance network info cache due to event network-changed-5fa9fdc0-cb64-4b32-967a-1e9ad346739e. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] Acquiring lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:33 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.neutron [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating instance_info_cache with network_info: [{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Releasing lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Instance network_info: |[{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] Acquired lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.neutron [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Refreshing network info cache for port 5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Start _get_guest_xml network_info=[{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:34 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:34 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674413544',display_name='tempest-VolumesAdminNegativeTest-server-1674413544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674413544',id=6,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE1bO3NJ48iwvWxDxfmhSNP0F/47x+XoAIFVYrhoRTVWgmPtHSOpsPtYU3LKHq2U0gr6JRArC0iJuQj525zClq4JrYxz1CTbKFUGAqIqFBDdA9sgdRErUm7lXFiD8DhqQ==',key_name='tempest-keypair-710013945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-j4mxopf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07467ef74ea34f21949b8a00da319315',uuid=0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.objects.instance [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'pci_devices' on Instance uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:34 user nova-compute[73110]:   <uuid>0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282</uuid>
Aug 26 17:40:34 user nova-compute[73110]:   <name>instance-00000006</name>
Aug 26 17:40:34 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:34 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:34 user nova-compute[73110]:   <metadata>
Aug 26 17:40:34 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:34 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1674413544</nova:name>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:34</nova:creationTime>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:34 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:34 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:user uuid="07467ef74ea34f21949b8a00da319315">tempest-VolumesAdminNegativeTest-154505172-project-member</nova:user>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:project uuid="88799fc21bb642ecb30f13d1b9ba20d7">tempest-VolumesAdminNegativeTest-154505172</nova:project>
Aug 26 17:40:34 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:34 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:34 user nova-compute[73110]:         <nova:port uuid="5fa9fdc0-cb64-4b32-967a-1e9ad346739e">
Aug 26 17:40:34 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 17:40:34 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:34 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:34 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:34 user nova-compute[73110]:   </metadata>
Aug 26 17:40:34 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:34 user nova-compute[73110]:     <system>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="serial">0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282</entry>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="uuid">0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282</entry>
Aug 26 17:40:34 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:34 user nova-compute[73110]:     </system>
Aug 26 17:40:34 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:34 user nova-compute[73110]:   <os>
Aug 26 17:40:34 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:34 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:34 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:34 user nova-compute[73110]:   </os>
Aug 26 17:40:34 user nova-compute[73110]:   <features>
Aug 26 17:40:34 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:34 user nova-compute[73110]:     <apic/>
Aug 26 17:40:34 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:34 user nova-compute[73110]:   </features>
Aug 26 17:40:34 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:34 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:34 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:34 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:34 user nova-compute[73110]:   </clock>
Aug 26 17:40:34 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:34 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:34 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:34 user nova-compute[73110]:   </cpu>
Aug 26 17:40:34 user nova-compute[73110]:   <devices>
Aug 26 17:40:34 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:34 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:34 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk"/>
Aug 26 17:40:34 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:34 user nova-compute[73110]:     </disk>
Aug 26 17:40:34 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:34 user nova-compute[73110]:       <mac address="fa:16:3e:eb:0c:ff"/>
Aug 26 17:40:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:34 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:34 user nova-compute[73110]:       <target dev="tap5fa9fdc0-cb"/>
Aug 26 17:40:34 user nova-compute[73110]:     </interface>
Aug 26 17:40:34 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:34 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/console.log" append="off"/>
Aug 26 17:40:34 user nova-compute[73110]:     </serial>
Aug 26 17:40:34 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:34 user nova-compute[73110]:     <video>
Aug 26 17:40:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:34 user nova-compute[73110]:     </video>
Aug 26 17:40:34 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:34 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:34 user nova-compute[73110]:     </rng>
Aug 26 17:40:34 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:34 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:34 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:34 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:34 user nova-compute[73110]:   </devices>
Aug 26 17:40:34 user nova-compute[73110]: </domain>
Aug 26 17:40:34 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674413544',display_name='tempest-VolumesAdminNegativeTest-server-1674413544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674413544',id=6,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE1bO3NJ48iwvWxDxfmhSNP0F/47x+XoAIFVYrhoRTVWgmPtHSOpsPtYU3LKHq2U0gr6JRArC0iJuQj525zClq4JrYxz1CTbKFUGAqIqFBDdA9sgdRErUm7lXFiD8DhqQ==',key_name='tempest-keypair-710013945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-j4mxopf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07467ef74ea34f21949b8a00da319315',uuid=0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG os_vif [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fa9fdc0-cb, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fa9fdc0-cb, col_values=(('external_ids', {'iface-id': '5fa9fdc0-cb64-4b32-967a-1e9ad346739e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:0c:ff', 'vm-uuid': '0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:34 user nova-compute[73110]: INFO os_vif [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb')
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No VIF found with MAC fa:16:3e:eb:0c:ff, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updated VIF entry in instance network info cache for port 5fa9fdc0-cb64-4b32-967a-1e9ad346739e. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating instance_info_cache with network_info: [{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c5f659af-d92a-4cd1-bd64-9509642bab3e req-75819524-d94b-4ce6-b6f8-0a0264928a03 service nova] Releasing lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:37 user nova-compute[73110]: INFO nova.compute.claims [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Claim successful on node user
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:38 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.policy [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d939fc60c0248d3a860e2a0686ac121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1978b0cd4f4765bad982b13a27b7e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:38 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Creating image(s)
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071639.284396, 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] VM Resumed (Lifecycle Event)
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Instance spawned successfully.
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.part --force-share --output=json" returned: 0 in 0.313s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071639.2889135, 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] VM Started (Lifecycle Event)
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.virt.images [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] dce8e00e-612e-4ad0-9d17-f948a832ca7f was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.part /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Took 10.22 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:39 user nova-compute[73110]: INFO nova.compute.manager [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Took 11.67 seconds to build instance.
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-650fee0c-66f5-4d10-8720-b5d326aa4ef0 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.890s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.part /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.converted" returned: 0 in 0.362s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Successfully created port: 767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.322s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:40 user nova-compute[73110]: INFO nova.compute.claims [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Claim successful on node user
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe,backing_fmt=raw /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe,backing_fmt=raw /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk 1073741824" returned: 0 in 0.061s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe --force-share --output=json" returned: 0 in 0.250s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Cannot resize image /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Ensure instance console log exists: /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.906s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.policy [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7daeea86e0294f44ade0b14af6da68bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ae0a534fda47dbab6f087aee299812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Creating image(s)
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "/opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "/opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Successfully updated port: 767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquired lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-changed-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Refreshing instance network info cache due to event network-changed-767cc0c4-e285-4682-b7c2-2cad845a0ddf. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] Acquiring lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.269s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.378s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk 1073741824" returned: 0 in 0.071s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.456s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Successfully created port: ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.255s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] No waiting events found dispatching network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:42 user nova-compute[73110]: WARNING nova.compute.manager [req-5c9933f2-f0b3-4aea-a602-19f14b48ddf8 req-37aa1a6a-b834-42e9-9255-d176950a388b service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received unexpected event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 for instance with vm_state active and task_state None.
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Cannot resize image /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Ensure instance console log exists: /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.network.neutron [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updating instance_info_cache with network_info: [{"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Releasing lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Instance network_info: |[{"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] Acquired lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Refreshing network info cache for port 767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Start _get_guest_xml network_info=[{"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:40:26Z,direct_url=<?>,disk_format='qcow2',id=dce8e00e-612e-4ad0-9d17-f948a832ca7f,min_disk=0,min_ram=0,name='',owner='d024c7d1ae504322892726d909d8701b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:40:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dce8e00e-612e-4ad0-9d17-f948a832ca7f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:40:26Z,direct_url=<?>,disk_format='qcow2',id=dce8e00e-612e-4ad0-9d17-f948a832ca7f,min_disk=0,min_ram=0,name='',owner='d024c7d1ae504322892726d909d8701b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:40:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1373177481',display_name='tempest-AttachSCSIVolumeTestJSON-server-1373177481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1373177481',id=7,image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbaRhWbgy00E1Y3jo/4XrbdZxexNXm6CCOGziesaQjSLEs8Yo7YFAaYQ+BddrE7exkU1XmXmMsH9sbX/2k0Jo6x7MMy1yELu7kY4yeHsCuqU3lh08q41X50K7OmvDs0gw==',key_name='tempest-keypair-1315577117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1978b0cd4f4765bad982b13a27b7e2',ramdisk_id='',reservation_id='r-0ocygk00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-756870323',owner_user_name='tempest-AttachSCSIVolumeTestJSON-756870323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d939fc60c0248d3a860e2a0686ac121',uuid=9c5fcd4b-2df1-485e-a979-30fda49229b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converting VIF {"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.objects.instance [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:43 user nova-compute[73110]:   <uuid>9c5fcd4b-2df1-485e-a979-30fda49229b3</uuid>
Aug 26 17:40:43 user nova-compute[73110]:   <name>instance-00000007</name>
Aug 26 17:40:43 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:43 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:43 user nova-compute[73110]:   <metadata>
Aug 26 17:40:43 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:43 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1373177481</nova:name>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:42</nova:creationTime>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:43 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:43 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:user uuid="3d939fc60c0248d3a860e2a0686ac121">tempest-AttachSCSIVolumeTestJSON-756870323-project-member</nova:user>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:project uuid="be1978b0cd4f4765bad982b13a27b7e2">tempest-AttachSCSIVolumeTestJSON-756870323</nova:project>
Aug 26 17:40:43 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:root type="image" uuid="dce8e00e-612e-4ad0-9d17-f948a832ca7f"/>
Aug 26 17:40:43 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:43 user nova-compute[73110]:         <nova:port uuid="767cc0c4-e285-4682-b7c2-2cad845a0ddf">
Aug 26 17:40:43 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 17:40:43 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:43 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:43 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:43 user nova-compute[73110]:   </metadata>
Aug 26 17:40:43 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:43 user nova-compute[73110]:     <system>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="serial">9c5fcd4b-2df1-485e-a979-30fda49229b3</entry>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="uuid">9c5fcd4b-2df1-485e-a979-30fda49229b3</entry>
Aug 26 17:40:43 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:43 user nova-compute[73110]:     </system>
Aug 26 17:40:43 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:43 user nova-compute[73110]:   <os>
Aug 26 17:40:43 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:43 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:43 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:43 user nova-compute[73110]:   </os>
Aug 26 17:40:43 user nova-compute[73110]:   <features>
Aug 26 17:40:43 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:43 user nova-compute[73110]:     <apic/>
Aug 26 17:40:43 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:43 user nova-compute[73110]:   </features>
Aug 26 17:40:43 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:43 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:43 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:43 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:43 user nova-compute[73110]:   </clock>
Aug 26 17:40:43 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:43 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:43 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:43 user nova-compute[73110]:   </cpu>
Aug 26 17:40:43 user nova-compute[73110]:   <devices>
Aug 26 17:40:43 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:43 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:43 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk"/>
Aug 26 17:40:43 user nova-compute[73110]:       <target dev="sda" bus="scsi"/>
Aug 26 17:40:43 user nova-compute[73110]:       <address type="drive" controller="0" unit="0"/>
Aug 26 17:40:43 user nova-compute[73110]:     </disk>
Aug 26 17:40:43 user nova-compute[73110]:     <disk type="file" device="cdrom">
Aug 26 17:40:43 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 17:40:43 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.config"/>
Aug 26 17:40:43 user nova-compute[73110]:       <target dev="sdb" bus="scsi"/>
Aug 26 17:40:43 user nova-compute[73110]:       <address type="drive" controller="0" unit="1"/>
Aug 26 17:40:43 user nova-compute[73110]:     </disk>
Aug 26 17:40:43 user nova-compute[73110]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 17:40:43 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:43 user nova-compute[73110]:       <mac address="fa:16:3e:74:98:2f"/>
Aug 26 17:40:43 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:43 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:43 user nova-compute[73110]:       <target dev="tap767cc0c4-e2"/>
Aug 26 17:40:43 user nova-compute[73110]:     </interface>
Aug 26 17:40:43 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:43 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/console.log" append="off"/>
Aug 26 17:40:43 user nova-compute[73110]:     </serial>
Aug 26 17:40:43 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:43 user nova-compute[73110]:     <video>
Aug 26 17:40:43 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:43 user nova-compute[73110]:     </video>
Aug 26 17:40:43 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:43 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:43 user nova-compute[73110]:     </rng>
Aug 26 17:40:43 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:43 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:43 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:43 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:43 user nova-compute[73110]:   </devices>
Aug 26 17:40:43 user nova-compute[73110]: </domain>
Aug 26 17:40:43 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1373177481',display_name='tempest-AttachSCSIVolumeTestJSON-server-1373177481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1373177481',id=7,image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbaRhWbgy00E1Y3jo/4XrbdZxexNXm6CCOGziesaQjSLEs8Yo7YFAaYQ+BddrE7exkU1XmXmMsH9sbX/2k0Jo6x7MMy1yELu7kY4yeHsCuqU3lh08q41X50K7OmvDs0gw==',key_name='tempest-keypair-1315577117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1978b0cd4f4765bad982b13a27b7e2',ramdisk_id='',reservation_id='r-0ocygk00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-756870323',owner_user_name='tempest-AttachSCSIVolumeTestJSON-756870323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d939fc60c0248d3a860e2a0686ac121',uuid=9c5fcd4b-2df1-485e-a979-30fda49229b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converting VIF {"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG os_vif [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap767cc0c4-e2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap767cc0c4-e2, col_values=(('external_ids', {'iface-id': '767cc0c4-e285-4682-b7c2-2cad845a0ddf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:98:2f', 'vm-uuid': '9c5fcd4b-2df1-485e-a979-30fda49229b3'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:43 user nova-compute[73110]: INFO os_vif [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2')
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No BDM found with device name sda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No VIF found with MAC fa:16:3e:74:98:2f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Using config drive
Aug 26 17:40:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updated VIF entry in instance network info cache for port 767cc0c4-e285-4682-b7c2-2cad845a0ddf. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updating instance_info_cache with network_info: [{"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2e30fae7-4a65-4d1d-b38d-685bd0bb18b2 req-8a3aa81c-70dc-4a06-b75e-37241fd01cda service nova] Releasing lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] No waiting events found dispatching network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:43 user nova-compute[73110]: WARNING nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received unexpected event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e for instance with vm_state active and task_state None.
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] No waiting events found dispatching network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:43 user nova-compute[73110]: WARNING nova.compute.manager [req-88e2e1c2-e98c-43a2-9128-722945fed112 req-bf14afed-b00a-4be5-91a6-cdbfc50d56c1 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received unexpected event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e for instance with vm_state active and task_state None.
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:44 user nova-compute[73110]: INFO nova.compute.claims [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Claim successful on node user
Aug 26 17:40:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Creating config drive at /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.config
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpthyyoenz {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpthyyoenz" returned: 0 in 0.062s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Successfully updated port: ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquired lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received event network-changed-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Refreshing instance network info cache due to event network-changed-ae34facd-388b-4be1-952c-0b491b39b805. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] Acquiring lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] No waiting events found dispatching network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:44 user nova-compute[73110]: WARNING nova.compute.manager [req-a22579c0-22bf-46e6-a4f3-360ac6cf3ebd req-593d0ef8-f4bc-4eb3-9576-59114e9c51e0 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received unexpected event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 for instance with vm_state active and task_state None.
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Creating image(s)
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.policy [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e86694272e4435b371b0bcfcf0ba7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2a980cd25b4845bc65840a49e61437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.302s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updating instance_info_cache with network_info: [{"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Releasing lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Instance network_info: |[{"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] Acquired lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.neutron [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Refreshing network info cache for port ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Start _get_guest_xml network_info=[{"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.261s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk 1073741824" returned: 0 in 0.085s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-691130618',display_name='tempest-TestVolumeSwap-server-691130618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-691130618',id=8,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPQXw8q8TFzIiINK2ciwNcuUPZan5sudKb1XQtY3O8sJED8wW+Ehh784jpj2qel2EjfA6AyZlqJURlkM7yyqMe/CIh/C8I3VktVTnirZx16uFjskJ+H5ERZjA7tdbs/1g==',key_name='tempest-keypair-268364097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ae0a534fda47dbab6f087aee299812',ramdisk_id='',reservation_id='r-quay0ym0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1718376852',owner_user_name='tempest-TestVolumeSwap-1718376852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7daeea86e0294f44ade0b14af6da68bb',uuid=3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converting VIF {"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:45 user nova-compute[73110]:   <uuid>3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c</uuid>
Aug 26 17:40:45 user nova-compute[73110]:   <name>instance-00000008</name>
Aug 26 17:40:45 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:45 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:45 user nova-compute[73110]:   <metadata>
Aug 26 17:40:45 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:45 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:name>tempest-TestVolumeSwap-server-691130618</nova:name>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:45</nova:creationTime>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:45 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:45 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:user uuid="7daeea86e0294f44ade0b14af6da68bb">tempest-TestVolumeSwap-1718376852-project-member</nova:user>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:project uuid="d9ae0a534fda47dbab6f087aee299812">tempest-TestVolumeSwap-1718376852</nova:project>
Aug 26 17:40:45 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:45 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:45 user nova-compute[73110]:         <nova:port uuid="ae34facd-388b-4be1-952c-0b491b39b805">
Aug 26 17:40:45 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 17:40:45 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:45 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:45 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:45 user nova-compute[73110]:   </metadata>
Aug 26 17:40:45 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:45 user nova-compute[73110]:     <system>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="serial">3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c</entry>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="uuid">3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c</entry>
Aug 26 17:40:45 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:45 user nova-compute[73110]:     </system>
Aug 26 17:40:45 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:45 user nova-compute[73110]:   <os>
Aug 26 17:40:45 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:45 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:45 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:45 user nova-compute[73110]:   </os>
Aug 26 17:40:45 user nova-compute[73110]:   <features>
Aug 26 17:40:45 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:45 user nova-compute[73110]:     <apic/>
Aug 26 17:40:45 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:45 user nova-compute[73110]:   </features>
Aug 26 17:40:45 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:45 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:45 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:45 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:45 user nova-compute[73110]:   </clock>
Aug 26 17:40:45 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:45 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:45 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:45 user nova-compute[73110]:   </cpu>
Aug 26 17:40:45 user nova-compute[73110]:   <devices>
Aug 26 17:40:45 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:45 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:45 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk"/>
Aug 26 17:40:45 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:45 user nova-compute[73110]:     </disk>
Aug 26 17:40:45 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:45 user nova-compute[73110]:       <mac address="fa:16:3e:8c:a9:23"/>
Aug 26 17:40:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:45 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:45 user nova-compute[73110]:       <target dev="tapae34facd-38"/>
Aug 26 17:40:45 user nova-compute[73110]:     </interface>
Aug 26 17:40:45 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:45 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/console.log" append="off"/>
Aug 26 17:40:45 user nova-compute[73110]:     </serial>
Aug 26 17:40:45 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:45 user nova-compute[73110]:     <video>
Aug 26 17:40:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:45 user nova-compute[73110]:     </video>
Aug 26 17:40:45 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:45 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:45 user nova-compute[73110]:     </rng>
Aug 26 17:40:45 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:45 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:45 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:45 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:45 user nova-compute[73110]:   </devices>
Aug 26 17:40:45 user nova-compute[73110]: </domain>
Aug 26 17:40:45 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-691130618',display_name='tempest-TestVolumeSwap-server-691130618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-691130618',id=8,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPQXw8q8TFzIiINK2ciwNcuUPZan5sudKb1XQtY3O8sJED8wW+Ehh784jpj2qel2EjfA6AyZlqJURlkM7yyqMe/CIh/C8I3VktVTnirZx16uFjskJ+H5ERZjA7tdbs/1g==',key_name='tempest-keypair-268364097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ae0a534fda47dbab6f087aee299812',ramdisk_id='',reservation_id='r-quay0ym0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1718376852',owner_user_name='tempest-TestVolumeSwap-1718376852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7daeea86e0294f44ade0b14af6da68bb',uuid=3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converting VIF {"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG os_vif [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae34facd-38, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae34facd-38, col_values=(('external_ids', {'iface-id': 'ae34facd-388b-4be1-952c-0b491b39b805', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:a9:23', 'vm-uuid': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:45 user nova-compute[73110]: INFO os_vif [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38')
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.332s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] No VIF found with MAC fa:16:3e:8c:a9:23, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Cannot resize image /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Successfully created port: e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:40:46 user nova-compute[73110]: INFO nova.compute.claims [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Claim successful on node user
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updated VIF entry in instance network info cache for port ae34facd-388b-4be1-952c-0b491b39b805. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updating instance_info_cache with network_info: [{"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-884554b5-9c62-42f8-b2a5-115614c9a83b req-002b85cc-855b-414f-9a28-381ca46ffdf8 service nova] Releasing lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:40:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:40:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Creating image(s)
Aug 26 17:40:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "/opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "/opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.policy [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13439fcd22a44eda929d6b9f57431c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd4c4da9abd4c7c896e84d64b24f02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.274s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.249s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk 1073741824" returned: 0 in 0.079s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Successfully updated port: e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-changed-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing instance network info cache due to event network-changed-e1957e20-b950-410f-9f65-3fb54406a445. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing network info cache for port e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid c66c6639-1168-477d-9f15-30e31cbb2369 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.248s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:48 user nova-compute[73110]: WARNING nova.compute.manager [req-563201af-eafd-4962-a083-03130081d9d8 req-75c92a71-ca4f-433f-8b01-28ed440eea74 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state None.
Aug 26 17:40:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Cannot resize image /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Ensure instance console log exists: /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-865b7800-96d0-44b4-bc59-e8fa95cc408c req-13e07b08-e0ba-4322-9241-d4eb4e4e82e2 service nova] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Successfully created port: 90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updating instance_info_cache with network_info: [{"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-c66c6639-1168-477d-9f15-30e31cbb2369" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071649.7932773, 9c5fcd4b-2df1-485e-a979-30fda49229b3 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] VM Resumed (Lifecycle Event)
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Instance spawned successfully.
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071649.7944722, 9c5fcd4b-2df1-485e-a979-30fda49229b3 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] VM Started (Lifecycle Event)
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance network_info: |[{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Start _get_guest_xml network_info=[{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:49 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:49 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.objects.instance [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'pci_devices' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Took 11.26 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:50 user nova-compute[73110]:   <uuid>fc65c329-e780-4927-994c-defa1e9d4ea7</uuid>
Aug 26 17:40:50 user nova-compute[73110]:   <name>instance-00000009</name>
Aug 26 17:40:50 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:50 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:50 user nova-compute[73110]:   <metadata>
Aug 26 17:40:50 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:50 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:name>tempest-device-tagging-server-608315562</nova:name>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:49</nova:creationTime>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:50 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:50 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:user uuid="78e86694272e4435b371b0bcfcf0ba7a">tempest-TaggedAttachmentsTest-646385816-project-member</nova:user>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:project uuid="dc2a980cd25b4845bc65840a49e61437">tempest-TaggedAttachmentsTest-646385816</nova:project>
Aug 26 17:40:50 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:50 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:50 user nova-compute[73110]:         <nova:port uuid="e1957e20-b950-410f-9f65-3fb54406a445">
Aug 26 17:40:50 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:40:50 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:50 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:50 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:50 user nova-compute[73110]:   </metadata>
Aug 26 17:40:50 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:50 user nova-compute[73110]:     <system>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="serial">fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="uuid">fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:40:50 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:50 user nova-compute[73110]:     </system>
Aug 26 17:40:50 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:50 user nova-compute[73110]:   <os>
Aug 26 17:40:50 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:50 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:50 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:50 user nova-compute[73110]:   </os>
Aug 26 17:40:50 user nova-compute[73110]:   <features>
Aug 26 17:40:50 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:50 user nova-compute[73110]:     <apic/>
Aug 26 17:40:50 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:50 user nova-compute[73110]:   </features>
Aug 26 17:40:50 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:50 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:50 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:50 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:50 user nova-compute[73110]:   </clock>
Aug 26 17:40:50 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:50 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:50 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:50 user nova-compute[73110]:   </cpu>
Aug 26 17:40:50 user nova-compute[73110]:   <devices>
Aug 26 17:40:50 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:50 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:50 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk"/>
Aug 26 17:40:50 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:50 user nova-compute[73110]:     </disk>
Aug 26 17:40:50 user nova-compute[73110]:     <disk type="file" device="cdrom">
Aug 26 17:40:50 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 17:40:50 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config"/>
Aug 26 17:40:50 user nova-compute[73110]:       <target dev="hda" bus="ide"/>
Aug 26 17:40:50 user nova-compute[73110]:     </disk>
Aug 26 17:40:50 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:50 user nova-compute[73110]:       <mac address="fa:16:3e:2f:f7:82"/>
Aug 26 17:40:50 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:50 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:50 user nova-compute[73110]:       <target dev="tape1957e20-b9"/>
Aug 26 17:40:50 user nova-compute[73110]:     </interface>
Aug 26 17:40:50 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:50 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log" append="off"/>
Aug 26 17:40:50 user nova-compute[73110]:     </serial>
Aug 26 17:40:50 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:50 user nova-compute[73110]:     <video>
Aug 26 17:40:50 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:50 user nova-compute[73110]:     </video>
Aug 26 17:40:50 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:50 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:50 user nova-compute[73110]:     </rng>
Aug 26 17:40:50 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:50 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:50 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:50 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:50 user nova-compute[73110]:   </devices>
Aug 26 17:40:50 user nova-compute[73110]: </domain>
Aug 26 17:40:50 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG os_vif [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1957e20-b9, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1957e20-b9, col_values=(('external_ids', {'iface-id': 'e1957e20-b950-410f-9f65-3fb54406a445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:f7:82', 'vm-uuid': 'fc65c329-e780-4927-994c-defa1e9d4ea7'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:50 user nova-compute[73110]: INFO os_vif [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9')
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name hda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No VIF found with MAC fa:16:3e:2f:f7:82, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Using config drive
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Took 12.36 seconds to build instance.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-54e1b01b-6904-4f14-a81d-c101e026ef00 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.537s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Creating config drive at /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq4vphhqk {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071650.4506953, 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] VM Resumed (Lifecycle Event)
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Successfully updated port: 90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq4vphhqk" returned: 0 in 0.077s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquired lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-changed-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Refreshing instance network info cache due to event network-changed-90bc7b8b-188a-4c3d-83ca-cb93169628bc. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] Acquiring lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Instance spawned successfully.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071650.4508204, 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] VM Started (Lifecycle Event)
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Took 9.18 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:50 user nova-compute[73110]: WARNING nova.compute.manager [req-367efafb-2819-4b6d-a4b0-76f50f1a2d82 req-2ed1dcd8-f094-445b-b236-e6ff6054ca9d service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state None.
Aug 26 17:40:50 user nova-compute[73110]: INFO nova.compute.manager [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Took 10.86 seconds to build instance.
Aug 26 17:40:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3bb9e7b7-964a-4ef8-9477-51ab9960a57a tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.139s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.neutron [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updating instance_info_cache with network_info: [{"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Releasing lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Instance network_info: |[{"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] Acquired lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.neutron [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Refreshing network info cache for port 90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Start _get_guest_xml network_info=[{"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:40:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-531882543',display_name='tempest-VolumesAssistedSnapshotsTest-server-531882543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-531882543',id=10,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBOyrZ9KglT6DfMKSwx7qZ0oBuBLoC6Ts/jg2tAgLPCOEHa6j4Fa3iYLCaxyvsc0UJW/erW6SXETmZDrsp5mHQg5mjWc0P6PX57ufz8WBkW3NHM/bVhmlYGWTNJk/3O6w==',key_name='tempest-keypair-67120618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd4c4da9abd4c7c896e84d64b24f02c',ramdisk_id='',reservation_id='r-j08at3p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2091022039',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2091022039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13439fcd22a44eda929d6b9f57431c0',uuid=66e24787-eb7a-48f9-85bc-b99392dc21a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converting VIF {"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:40:51 user nova-compute[73110]:   <uuid>66e24787-eb7a-48f9-85bc-b99392dc21a8</uuid>
Aug 26 17:40:51 user nova-compute[73110]:   <name>instance-0000000a</name>
Aug 26 17:40:51 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:40:51 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:40:51 user nova-compute[73110]:   <metadata>
Aug 26 17:40:51 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:40:51 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-531882543</nova:name>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:40:51</nova:creationTime>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:40:51 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:40:51 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:owner>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:user uuid="a13439fcd22a44eda929d6b9f57431c0">tempest-VolumesAssistedSnapshotsTest-2091022039-project-member</nova:user>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:project uuid="1bd4c4da9abd4c7c896e84d64b24f02c">tempest-VolumesAssistedSnapshotsTest-2091022039</nova:project>
Aug 26 17:40:51 user nova-compute[73110]:       </nova:owner>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:40:51 user nova-compute[73110]:       <nova:ports>
Aug 26 17:40:51 user nova-compute[73110]:         <nova:port uuid="90bc7b8b-188a-4c3d-83ca-cb93169628bc">
Aug 26 17:40:51 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 17:40:51 user nova-compute[73110]:         </nova:port>
Aug 26 17:40:51 user nova-compute[73110]:       </nova:ports>
Aug 26 17:40:51 user nova-compute[73110]:     </nova:instance>
Aug 26 17:40:51 user nova-compute[73110]:   </metadata>
Aug 26 17:40:51 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:40:51 user nova-compute[73110]:     <system>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="serial">66e24787-eb7a-48f9-85bc-b99392dc21a8</entry>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="uuid">66e24787-eb7a-48f9-85bc-b99392dc21a8</entry>
Aug 26 17:40:51 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:40:51 user nova-compute[73110]:     </system>
Aug 26 17:40:51 user nova-compute[73110]:   </sysinfo>
Aug 26 17:40:51 user nova-compute[73110]:   <os>
Aug 26 17:40:51 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:40:51 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:40:51 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:40:51 user nova-compute[73110]:   </os>
Aug 26 17:40:51 user nova-compute[73110]:   <features>
Aug 26 17:40:51 user nova-compute[73110]:     <acpi/>
Aug 26 17:40:51 user nova-compute[73110]:     <apic/>
Aug 26 17:40:51 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:40:51 user nova-compute[73110]:   </features>
Aug 26 17:40:51 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:40:51 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:40:51 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:40:51 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:40:51 user nova-compute[73110]:   </clock>
Aug 26 17:40:51 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:40:51 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:40:51 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:40:51 user nova-compute[73110]:   </cpu>
Aug 26 17:40:51 user nova-compute[73110]:   <devices>
Aug 26 17:40:51 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:40:51 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:40:51 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk"/>
Aug 26 17:40:51 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:40:51 user nova-compute[73110]:     </disk>
Aug 26 17:40:51 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:40:51 user nova-compute[73110]:       <mac address="fa:16:3e:f9:0b:7f"/>
Aug 26 17:40:51 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:51 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:40:51 user nova-compute[73110]:       <target dev="tap90bc7b8b-18"/>
Aug 26 17:40:51 user nova-compute[73110]:     </interface>
Aug 26 17:40:51 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:40:51 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/console.log" append="off"/>
Aug 26 17:40:51 user nova-compute[73110]:     </serial>
Aug 26 17:40:51 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:40:51 user nova-compute[73110]:     <video>
Aug 26 17:40:51 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:40:51 user nova-compute[73110]:     </video>
Aug 26 17:40:51 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:40:51 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:40:51 user nova-compute[73110]:     </rng>
Aug 26 17:40:51 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:40:51 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:40:51 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:40:51 user nova-compute[73110]:     </memballoon>
Aug 26 17:40:51 user nova-compute[73110]:   </devices>
Aug 26 17:40:51 user nova-compute[73110]: </domain>
Aug 26 17:40:51 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-531882543',display_name='tempest-VolumesAssistedSnapshotsTest-server-531882543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-531882543',id=10,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBOyrZ9KglT6DfMKSwx7qZ0oBuBLoC6Ts/jg2tAgLPCOEHa6j4Fa3iYLCaxyvsc0UJW/erW6SXETmZDrsp5mHQg5mjWc0P6PX57ufz8WBkW3NHM/bVhmlYGWTNJk/3O6w==',key_name='tempest-keypair-67120618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd4c4da9abd4c7c896e84d64b24f02c',ramdisk_id='',reservation_id='r-j08at3p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2091022039',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2091022039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13439fcd22a44eda929d6b9f57431c0',uuid=66e24787-eb7a-48f9-85bc-b99392dc21a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converting VIF {"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG os_vif [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90bc7b8b-18, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90bc7b8b-18, col_values=(('external_ids', {'iface-id': '90bc7b8b-188a-4c3d-83ca-cb93169628bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:0b:7f', 'vm-uuid': '66e24787-eb7a-48f9-85bc-b99392dc21a8'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:51 user nova-compute[73110]: INFO os_vif [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18')
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:40:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] No VIF found with MAC fa:16:3e:f9:0b:7f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updated VIF entry in instance network info cache for port 90bc7b8b-188a-4c3d-83ca-cb93169628bc. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updating instance_info_cache with network_info: [{"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a80ef8e8-c6e8-4936-9be4-5901b6a8bbf5 req-6ca192fe-470b-40ae-a0b8-0320c8e67479 service nova] Releasing lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] No waiting events found dispatching network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:52 user nova-compute[73110]: WARNING nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received unexpected event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf for instance with vm_state active and task_state None.
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] No waiting events found dispatching network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:52 user nova-compute[73110]: WARNING nova.compute.manager [req-a755fb86-7bd8-40d5-9566-d70d28883ce2 req-efa3ee47-b778-4248-ac1b-e6df96ec7392 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received unexpected event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf for instance with vm_state active and task_state None.
Aug 26 17:40:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] No waiting events found dispatching network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:54 user nova-compute[73110]: WARNING nova.compute.manager [req-293c79bf-c89b-47b7-8be7-4d5854d4c9cd req-20a1a742-e9cc-4356-b533-b5983d148878 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received unexpected event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc for instance with vm_state building and task_state spawning.
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:54 user nova-compute[73110]: WARNING nova.compute.manager [req-04547e3d-da89-47b1-b320-8656b2ccfbe6 req-5e4eb0ef-b857-4360-b3a0-b5479dffc579 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state None.
Aug 26 17:40:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071656.8523724, fc65c329-e780-4927-994c-defa1e9d4ea7 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] VM Resumed (Lifecycle Event)
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] No waiting events found dispatching network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:56 user nova-compute[73110]: WARNING nova.compute.manager [req-b8924c3a-a118-4b81-924d-57553e3d7892 req-667a7c41-4b0d-4674-8c64-22564da9a691 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received unexpected event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc for instance with vm_state building and task_state spawning.
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:40:56 user nova-compute[73110]: WARNING nova.compute.manager [req-45965ea2-5eca-4890-8410-40f1021a7c9f req-f7bb6d7e-4a2f-4159-b14d-c21ebced9d80 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state None.
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance spawned successfully.
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:56 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071656.853802, fc65c329-e780-4927-994c-defa1e9d4ea7 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] VM Started (Lifecycle Event)
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071657.1256735, 66e24787-eb7a-48f9-85bc-b99392dc21a8 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] VM Resumed (Lifecycle Event)
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Took 12.11 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Instance spawned successfully.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071657.1261299, 66e24787-eb7a-48f9-85bc-b99392dc21a8 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] VM Started (Lifecycle Event)
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Took 13.40 seconds to build instance.
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Took 9.62 seconds to spawn the instance on the hypervisor.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-662db77b-31e8-41bf-aa05-140b21d1084a tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.530s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:57 user nova-compute[73110]: INFO nova.compute.manager [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Took 10.93 seconds to build instance.
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d658e15-e33c-4127-8619-c6a89fc44633 tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.147s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:40:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:41:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.696800231933594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance c66c6639-1168-477d-9f15-30e31cbb2369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance fc65c329-e780-4927-994c-defa1e9d4ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 17:41:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.066s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received event network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] No waiting events found dispatching network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:41:01 user nova-compute[73110]: WARNING nova.compute.manager [req-20f640b2-5e4d-4037-8b81-b8b85ec38d17 req-9e11d781-6660-4ba9-b46f-e876cbe49401 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received unexpected event network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 for instance with vm_state active and task_state None.
Aug 26 17:41:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received event network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] No waiting events found dispatching network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:41:03 user nova-compute[73110]: WARNING nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received unexpected event network-vif-plugged-ae34facd-388b-4be1-952c-0b491b39b805 for instance with vm_state active and task_state None.
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:41:03 user nova-compute[73110]: WARNING nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 for instance with vm_state active and task_state None.
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:41:03 user nova-compute[73110]: WARNING nova.compute.manager [req-e366b814-ef1a-4f47-b25b-5090c1af51b5 req-e04a0121-7746-4b2e-b3c5-08a77eec34a7 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 for instance with vm_state active and task_state None.
Aug 26 17:41:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:41:33 user nova-compute[73110]: INFO nova.compute.claims [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Claim successful on node user
Aug 26 17:41:33 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:41:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:41:34 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:41:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:41:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:41:34 user nova-compute[73110]: INFO nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Booting with volume 357ad1d8-b9fc-4095-b428-13961c121ac1 at /dev/vda
Aug 26 17:41:34 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:41:34 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1pxp24xa/privsep.sock']
Aug 26 17:41:34 user nova-compute[73110]: DEBUG nova.policy [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9299ff2802e84c5aabb805a8e24a025f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c55352049ba409081025c4dbdd32074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:41:34 user sudo[84430]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1pxp24xa/privsep.sock
Aug 26 17:41:34 user sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 17:41:34 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully created port: 18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:41:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully created port: 9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:41:35 user sudo[84430]: pam_unix(sudo:session): session closed for user root
Aug 26 17:41:35 user nova-compute[73110]: INFO oslo.privsep.daemon [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Spawned new privsep daemon via rootwrap
Aug 26 17:41:35 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 17:41:35 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 17:41:35 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 17:41:35 user nova-compute[73110]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84436
Aug 26 17:41:35 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a90391-43ed-4537-aa3d-7d23243838fb]: (2,) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully created port: 02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd35420-cdf2-4911-abc2-df4ca24a235e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: WARNING os_brick.initiator.connectors.nvmeof [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaa2339-4bc9-4a61-aeb8-d2d73323d302]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ceda5-af51-4458-b453-fa63d4ec0d04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[236ba3b9-f520-41f2-a70d-e126d6bd51d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:36 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:41:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e81db-9366-496e-8e4b-8025fdcd4874]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== get_connector_properties: return (2000ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating existing volume attachment record: 5075b9b4-c2ff-4f37-b306-25da734f84e2 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:41:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully created port: e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:41:37 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully created port: 763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: 18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-18221bdb-6702-49fd-8e9c-43f1b9a123b5. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5e6a8ed7-6b82-44a8-8433-314bdc82b045 req-ce12c11e-15f3-4f59-9245-36cb6ed34c50 service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:39 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: 19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-e69898df-f0e1-44ee-bbbc-0338e9962b08. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6ce0451e-0501-4eb4-bfab-4c4cd7fab98d req-a3ef05dd-1efa-4186-9b94-86900ed12223 service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: 9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: 02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-19cf314d-711b-4f86-9d51-4318829c0a19. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-9131187f-abd4-4708-ad42-090fd8510554. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-02b2cbe2-cd70-4478-b393-5c2a5c45127a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ac37921-071e-46b2-8242-6577430ab06d req-1fabd10a-0a74-402d-bd69-e113ccbf522e service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Successfully updated port: 763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c6a80417-5bb6-4897-a169-6493e48bccda req-398d9d79-59ef-4516-8a03-bafd78f82065 service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:41:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-763088fd-674f-43b4-a3bd-eafb7f61dab6. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance network_info: |[{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG nova.network.neutron [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updated VIF entry in instance network info cache for port 763088fd-674f-43b4-a3bd-eafb7f61dab6. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG nova.network.neutron [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-562920e2-b776-40cc-bc3c-d8bb8f25fa18 req-68a10972-be20-4b50-be5f-c3dfaae3f3ce service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:47 user nova-compute[73110]: INFO nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Booting with volume 879020f1-b4ab-4aa8-ac51-9455e586f4dc at /dev/vdb
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc3e948-76ab-4386-9d8d-a893a0cf09c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b0ff1-c085-42b1-88ff-536392fbb749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989c867-b625-4617-a0c6-ec46376a5c6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe27f2e-0ce4-438b-ae20-e08bc2446d8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:47 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:41:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc57307-782c-4ba5-9f0e-79d7ff39a27f]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:41:47 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating existing volume attachment record: d073fe3c-8f47-45e9-9a70-17c8abf04ec8 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:41:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:41:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-changed-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing instance network info cache due to event network-changed-b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing network info cache for port b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG nova.objects.instance [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lazy-loading 'flavor' on Instance uuid c66c6639-1168-477d-9f15-30e31cbb2369 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:54 user nova-compute[73110]: INFO nova.compute.manager [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Attaching volume 98718efd-f8aa-4477-bbee-aec7421581e0 to /dev/vdb
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.utils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7657cec-dfbf-4991-8fe8-c175ec83b709]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[caddbd33-6b46-4763-8f74-2e746a953734]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c9426d-cdf3-48ef-bb3d-3b3db3faee86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[487e5a6f-9e43-4dd9-b29d-d341860c8329]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:54 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca62f89-6269-44d3-8c3f-ee2038211e13]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG os_brick.utils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updating existing volume attachment record: bc4389a0-9121-4b27-8cd4-eafd0fa7b211 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated VIF entry in instance network info cache for port b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bfa31315-de78-4726-9981-59b730b7a460 req-3f6a1091-f474-4401-9749-cfb1d497906f service nova] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-changed-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Refreshing instance network info cache due to event network-changed-bc99d4df-9d70-45f8-ba11-6965e6f146dc. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Refreshing network info cache for port bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updated VIF entry in instance network info cache for port bc99d4df-9d70-45f8-ba11-6965e6f146dc. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce8e4490-911f-4cda-b3dc-a93e678e9c92 req-b69486eb-1a09-4753-a4c1-63a83972f8e4 service nova] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:57 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:41:57 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=6889MB free_disk=25.570327758789062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance c66c6639-1168-477d-9f15-30e31cbb2369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance fc65c329-e780-4927-994c-defa1e9d4ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0611d638-abf0-45f2-8708-1cc2790ffe99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:41:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:41:58 user nova-compute[73110]: INFO nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Booting with volume 6f0766e7-540f-4445-a110-1f55632d56c6 at /dev/vdc
Aug 26 17:41:58 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15e48a-8e7e-49d8-8d93-8a8754bf414e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a311a-7ba5-442f-93e5-f2c0f6ff0b45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad51198-b5f4-49ad-9cff-9675297120ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e19a5f-27da-43ad-92f7-f6919c0eb4a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:41:59 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fdd86-55ba-4df9-9c7b-b9dd9072c454]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG os_brick.utils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating existing volume attachment record: 83350a2b-305a-4871-a048-97ab3ac529dc {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing instance network info cache due to event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:41:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:00 user nova-compute[73110]: DEBUG nova.network.neutron [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updated VIF entry in instance network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:00 user nova-compute[73110]: DEBUG nova.network.neutron [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-61443d61-d0ad-46eb-aed6-bfd6f1835e6f req-edd5e7d2-ae89-40d9-9fc4-6b9ad694f1c2 service nova] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:00 user nova-compute[73110]: INFO nova.compute.manager [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] instance snapshotting
Aug 26 17:42:00 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Beginning live snapshot process
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd.delta 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd.delta 1073741824" returned: 0 in 0.048s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 17:42:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73110) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 17:42:01 user nova-compute[73110]: INFO nova.virt.libvirt.host [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] UEFI support detected
Aug 26 17:42:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-changed-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Refreshing instance network info cache due to event network-changed-df549c20-9f92-4f6a-8ba4-90a7ea5605d0. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:01 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Refreshing network info cache for port df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updated VIF entry in instance network info cache for port df549c20-9f92-4f6a-8ba4-90a7ea5605d0. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce1f763a-4a93-4166-a6e4-82376fd4ddde req-74b47e65-6e01-48b1-84e9-072725e9e82a service nova] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:42:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 17:42:03 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:42:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd.delta /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd.delta /opt/stack/data/nova/instances/snapshots/tmpoqgt2j4i/df728aa776d1483caaf05da7010eebcd" returned: 0 in 0.459s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Snapshot extracted, beginning image upload
Aug 26 17:42:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Snapshot image upload complete
Aug 26 17:42:06 user nova-compute[73110]: INFO nova.compute.manager [None req-3dba8b16-215c-4f06-8e00-f455ae2f1c54 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Took 5.53 seconds to snapshot the instance on the hypervisor.
Aug 26 17:42:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:07 user nova-compute[73110]: DEBUG nova.objects.instance [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:08 user nova-compute[73110]: INFO nova.compute.manager [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Attaching volume 0de89c12-2d48-4021-9fac-fa17cf1aacc1 to /dev/vdb
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c69104-ab3b-44ae-ac82-d63e217f62d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb3a01-ab7b-4a60-bf7e-bbb21be75fb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72be601-d40d-412b-810b-c9af32bf33c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a86595-5958-4093-a37b-6e304b4d4634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:08 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7aee4-87e0-486d-8401-4c4ca4daaf81]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating existing volume attachment record: 9c4746a4-c4f5-4657-89ce-daf1e450de2b {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:42:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Creating image(s)
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Ensure instance console log exists: /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Start _get_guest_xml network_info=[{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5075b9b4-c2ff-4f37-b306-25da734f84e2', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtBmNYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0611d638-abf0-45f2-8708-1cc2790ffe99', 'attached_at': '', 'detached_at': '', 'volume_id': '357ad1d8-b9fc-4095-b428-13961c121ac1', 'serial': '357ad1d8-b9fc-4095-b428-13961c121ac1'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'd073fe3c-8f47-45e9-9a70-17c8abf04ec8', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eiwXMLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0611d638-abf0-45f2-8708-1cc2790ffe99', 'attached_at': '', 'detached_at': '', 'volume_id': '879020f1-b4ab-4aa8-ac51-9455e586f4dc', 'serial': '879020f1-b4ab-4aa8-ac51-9455e586f4dc'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '83350a2b-305a-4871-a048-97ab3ac529dc', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXPSROIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0611d638-abf0-45f2-8708-1cc2790ffe99', 'attached_at': '', 'detached_at': '', 'volume_id': '6f0766e7-540f-4445-a110-1f55632d56c6', 'serial': '6f0766e7-540f-4445-a110-1f55632d56c6'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:42:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:42:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connector [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Factory for ISCSI on None {{(pid=73110) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtBmNYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:11 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476a389-1712-46b4-a56f-93340df91b35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[da781a7a-378b-4586-920f-0a52630cbb34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1] added
Aug 26 17:42:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ed429-7319-4824-9d33-57e2c8a67156]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ebc4a9-9400-4676-8e9d-a8983f8bd1ce]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFtBmNYQ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFtBmNYQ" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d66dead-716b-4d89-8cb8-e846b130d7f3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFtBmNYQ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9814b6ae-5cb7-44b9-8b6d-716c40ffda96]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef8d8e-f669-4bac-919f-51de01614ede]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:42:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:42:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:42:11 user nova-compute[73110]: 
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf3f19e-df0b-4a85-957d-2820e0f02a33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260]
Aug 26 17:42:11 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[35930c2b-eb7f-4014-8c4b-e414146e25e6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa289d-eaca-44f0-9c26-9a46eb08e6d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd631c5-2934-4e3b-ad4a-86c945c3a19a]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtBmNYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26566393662363133', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566393662363133', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eiwXMLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:12 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:12 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:12 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe77ce-64c3-4672-b880-d74a3525e248]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:12 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6196923-7b49-436c-b6cf-9c3aacf2f5e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc] added
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[447dc31d-7380-4686-bda3-aed62470f158]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c40570b-0806-45c3-8517-9e640c2e1fa1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eiwXMLJl {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eiwXMLJl" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f5029-ff56-4fe3-858e-1ed179378c21]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eiwXMLJl'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ad53d-cd06-47ba-b132-0f076fccd6c1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf376a-6706-4a5a-8e3b-ee5a81d352a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f6f98c-2bed-438b-9290-ff52facd7fc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260]
Aug 26 17:42:12 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa49f96-7a25-495a-a8b5-ecc588344113]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033c97f-e736-4a75-b988-7963cdf324bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:12 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:12 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c4532a-3b5b-47d9-a662-304e41317211]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:12 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eiwXMLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23130326639643738', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130326639643738', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXPSROIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:13 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:13 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:13 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd66472b-fc22-4ed5-a56f-b34630ec4b77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:13 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1373d83-5571-4add-b579-2407a3ec8a4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6] added
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afeb1aa-02bc-44fb-a63a-ea32601f70d2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19960336-a632-42bf-b0ce-e89d7a6819d5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXPSROIf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXPSROIf" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece4cbf5-d116-4526-9166-e787a616fd81]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXPSROIf'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55813c-fd11-4f2d-95c1-53dcc230a3a0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d05cbc9-b5cd-4e07-abe9-acc243e781cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[840de029-3f12-4f79-8491-29eb457ec321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260]
Aug 26 17:42:14 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e618521-995d-43cb-a533-7d803ecc8c51]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4581c09-dc86-4e16-a1d3-e7c19f6033d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:14 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e5ca8-0eb2-4277-bc78-e4254ac67424]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXPSROIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26162626437313335', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162626437313335', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lazy-loading 'pci_devices' on Instance uuid 0611d638-abf0-45f2-8708-1cc2790ffe99 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:42:15 user nova-compute[73110]:   <uuid>0611d638-abf0-45f2-8708-1cc2790ffe99</uuid>
Aug 26 17:42:15 user nova-compute[73110]:   <name>instance-0000000b</name>
Aug 26 17:42:15 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:42:15 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:42:15 user nova-compute[73110]:   <metadata>
Aug 26 17:42:15 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:42:15 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:name>tempest-device-tagging-server-798519093</nova:name>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:42:11</nova:creationTime>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:42:15 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:42:15 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:owner>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:user uuid="9299ff2802e84c5aabb805a8e24a025f">tempest-TaggedBootDevicesTest_v242-1190867397-project-member</nova:user>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:project uuid="8c55352049ba409081025c4dbdd32074">tempest-TaggedBootDevicesTest_v242-1190867397</nova:project>
Aug 26 17:42:15 user nova-compute[73110]:       </nova:owner>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:42:15 user nova-compute[73110]:       <nova:ports>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="18221bdb-6702-49fd-8e9c-43f1b9a123b5">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="e69898df-f0e1-44ee-bbbc-0338e9962b08">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="19cf314d-711b-4f86-9d51-4318829c0a19">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="9131187f-abd4-4708-ad42-090fd8510554">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="02b2cbe2-cd70-4478-b393-5c2a5c45127a">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="e7f63dd3-75b1-4e78-b4a8-e26be0a9606e">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:         <nova:port uuid="763088fd-674f-43b4-a3bd-eafb7f61dab6">
Aug 26 17:42:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 17:42:15 user nova-compute[73110]:         </nova:port>
Aug 26 17:42:15 user nova-compute[73110]:       </nova:ports>
Aug 26 17:42:15 user nova-compute[73110]:     </nova:instance>
Aug 26 17:42:15 user nova-compute[73110]:   </metadata>
Aug 26 17:42:15 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:42:15 user nova-compute[73110]:     <system>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="serial">0611d638-abf0-45f2-8708-1cc2790ffe99</entry>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="uuid">0611d638-abf0-45f2-8708-1cc2790ffe99</entry>
Aug 26 17:42:15 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:42:15 user nova-compute[73110]:     </system>
Aug 26 17:42:15 user nova-compute[73110]:   </sysinfo>
Aug 26 17:42:15 user nova-compute[73110]:   <os>
Aug 26 17:42:15 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:42:15 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:42:15 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:42:15 user nova-compute[73110]:   </os>
Aug 26 17:42:15 user nova-compute[73110]:   <features>
Aug 26 17:42:15 user nova-compute[73110]:     <acpi/>
Aug 26 17:42:15 user nova-compute[73110]:     <apic/>
Aug 26 17:42:15 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:42:15 user nova-compute[73110]:   </features>
Aug 26 17:42:15 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:42:15 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:42:15 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:42:15 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:42:15 user nova-compute[73110]:   </clock>
Aug 26 17:42:15 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:42:15 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:42:15 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:42:15 user nova-compute[73110]:   </cpu>
Aug 26 17:42:15 user nova-compute[73110]:   <devices>
Aug 26 17:42:15 user nova-compute[73110]:     <disk type="file" device="cdrom">
Aug 26 17:42:15 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 17:42:15 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/disk.config"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="hda" bus="ide"/>
Aug 26 17:42:15 user nova-compute[73110]:     </disk>
Aug 26 17:42:15 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:42:15 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:15 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <serial>357ad1d8-b9fc-4095-b428-13961c121ac1</serial>
Aug 26 17:42:15 user nova-compute[73110]:     </disk>
Aug 26 17:42:15 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:42:15 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:15 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <serial>879020f1-b4ab-4aa8-ac51-9455e586f4dc</serial>
Aug 26 17:42:15 user nova-compute[73110]:     </disk>
Aug 26 17:42:15 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:42:15 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:15 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="vdc" bus="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <serial>6f0766e7-540f-4445-a110-1f55632d56c6</serial>
Aug 26 17:42:15 user nova-compute[73110]:     </disk>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:e3:76:95"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tap18221bdb-67"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:60:4d:b8"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tape69898df-f0"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:56:e2:3a"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tap19cf314d-71"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:81:2d:dc"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tap9131187f-ab"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:6b:53:62"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tap02b2cbe2-cd"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:dd:ad:23"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tape7f63dd3-75"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:42:15 user nova-compute[73110]:       <mac address="fa:16:3e:9e:1f:0c"/>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:42:15 user nova-compute[73110]:       <target dev="tap763088fd-67"/>
Aug 26 17:42:15 user nova-compute[73110]:     </interface>
Aug 26 17:42:15 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:42:15 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/console.log" append="off"/>
Aug 26 17:42:15 user nova-compute[73110]:     </serial>
Aug 26 17:42:15 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:42:15 user nova-compute[73110]:     <video>
Aug 26 17:42:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:42:15 user nova-compute[73110]:     </video>
Aug 26 17:42:15 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:42:15 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:42:15 user nova-compute[73110]:     </rng>
Aug 26 17:42:15 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:42:15 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:42:15 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:42:15 user nova-compute[73110]:     </memballoon>
Aug 26 17:42:15 user nova-compute[73110]:   </devices>
Aug 26 17:42:15 user nova-compute[73110]: </domain>
Aug 26 17:42:15 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18221bdb-67, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18221bdb-67, col_values=(('external_ids', {'iface-id': '18221bdb-6702-49fd-8e9c-43f1b9a123b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:76:95', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape69898df-f0, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape69898df-f0, col_values=(('external_ids', {'iface-id': 'e69898df-f0e1-44ee-bbbc-0338e9962b08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:4d:b8', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19cf314d-71, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19cf314d-71, col_values=(('external_ids', {'iface-id': '19cf314d-711b-4f86-9d51-4318829c0a19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:e2:3a', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9131187f-ab, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9131187f-ab, col_values=(('external_ids', {'iface-id': '9131187f-abd4-4708-ad42-090fd8510554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:2d:dc', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02b2cbe2-cd, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02b2cbe2-cd, col_values=(('external_ids', {'iface-id': '02b2cbe2-cd70-4478-b393-5c2a5c45127a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:53:62', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f63dd3-75, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f63dd3-75, col_values=(('external_ids', {'iface-id': 'e7f63dd3-75b1-4e78-b4a8-e26be0a9606e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:ad:23', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap763088fd-67, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap763088fd-67, col_values=(('external_ids', {'iface-id': '763088fd-674f-43b4-a3bd-eafb7f61dab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:1f:0c', 'vm-uuid': '0611d638-abf0-45f2-8708-1cc2790ffe99'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:15 user nova-compute[73110]: INFO os_vif [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67')
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] No BDM found with device name hda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] No VIF found with MAC fa:16:3e:e3:76:95, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] No VIF found with MAC fa:16:3e:6b:53:62, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Using config drive
Aug 26 17:42:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Creating config drive at /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/disk.config
Aug 26 17:42:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp238vdjgd {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp238vdjgd" returned: 0 in 0.052s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDQAlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:17 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:17 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:17 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba947b-3c55-4ee1-8b23-439e4c4c942d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:17 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[94303182-ad68-4145-9f8a-6234657b8519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0] added
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a0ff1-2a6b-4944-9f77-0ca7a5e4fc5c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47060c98-ab1f-4e16-a2ea-f5c41a1b1edf]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXDQAlJj {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXDQAlJj" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd224fd2-bc96-48d2-8f26-fcedfc82c1b9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXDQAlJj'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dfd356-cc95-4109-973d-12eea6c52be8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec10baa0-6788-454f-9193-f93aa9b07d3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe4d90-4a75-4558-b61e-82503577beb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260]
Aug 26 17:42:17 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39faf69-19e4-4f41-9a58-cc0f83422b0a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[deace963-2562-4f54-8695-5d1a47101cd8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a17675-66eb-4c23-b151-0c828a2cabf0]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDQAlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:17 user nova-compute[73110]: WARNING nova.compute.manager [req-2c948b48-a9c8-4d51-b66b-acdc355a5f2b req-78bdc1fc-b0a2-4888-9cb8-e7e95438fa28 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 for instance with vm_state building and task_state spawning.
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26237383562313538', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383562313538', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lazy-loading 'flavor' on Instance uuid c66c6639-1168-477d-9f15-30e31cbb2369 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:18 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:18 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:18 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:18 user nova-compute[73110]:   <serial>98718efd-f8aa-4477-bbee-aec7421581e0</serial>
Aug 26 17:42:18 user nova-compute[73110]: </disk>
Aug 26 17:42:18 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:18 user nova-compute[73110]: WARNING nova.compute.manager [req-03b6ad89-df1f-4555-ba13-5a222067daae req-dfdbc7fb-c50e-4a8f-816a-e1a881777d42 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 for instance with vm_state building and task_state spawning.
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] No VIF found with MAC fa:16:3e:b6:49:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bcf41f95-814e-48dd-a7d7-7a931ae9e117 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.793s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:19 user nova-compute[73110]: WARNING nova.compute.manager [req-73237003-a21c-4318-b6b5-0b4e58027238 req-0fe5f65f-9274-4a1d-804b-ea7af239cc3b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e for instance with vm_state building and task_state spawning.
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:19 user nova-compute[73110]: WARNING nova.compute.manager [req-63fdb33f-393d-41d6-aaa0-0be695731699 req-d5223198-f878-4253-9073-ec776a0fe57b service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 for instance with vm_state building and task_state spawning.
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:20 user nova-compute[73110]: INFO nova.compute.manager [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Terminating instance
Aug 26 17:42:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:20 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:20 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:20 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc374ee-3b17-4794-8d8a-88ddb770d967]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:20 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[060593e2-ef6c-482c-bb07-376123ea16b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1] added
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[900bb43b-712b-4f00-8140-91483f981c77]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beccded-e936-49c2-90d6-45955a19aba9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdjevIQ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdjevIQ" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dce245-bd68-41ee-a2c6-385912f2c0d6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMdjevIQ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[85874089-fc0a-4d53-b2e6-3b8d6c26924c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[115c04bd-b830-4304-b17e-4c66fa9bdd0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846a0fb-72a9-4c99-9dfe-b927c01e4b12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]
Aug 26 17:42:20 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d0396-8245-4e36-91c1-4fe2cb5c34c6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8220a-42b3-4f95-8488-139c8073f7bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb88d9-3388-4215-9f6f-7ae921cdab50]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Instance destroyed successfully.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lazy-loading 'resources' on Instance uuid c66c6639-1168-477d-9f15-30e31cbb2369 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-changed-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Refreshing instance network info cache due to event network-changed-5fa9fdc0-cb64-4b32-967a-1e9ad346739e. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquired lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Refreshing network info cache for port 5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-798306127',display_name='tempest-DeleteServersTestJSON-server-798306127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-798306127',id=1,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5453ee9efa446ac99e294561ec2f170',ramdisk_id='',reservation_id='r-3ews8z13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-618857684',owner_user_name='tempest-DeleteServersTestJSON-618857684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:19Z,user_data=None,user_id='b90228eb1a2f45a5a618ddf8235f528d',uuid=c66c6639-1168-477d-9f15-30e31cbb2369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converting VIF {"id": "ed8e9322-db71-4892-b133-e74dcbe2968a", "address": "fa:16:3e:b6:49:4f", "network": {"id": "4625951b-6d36-4501-99da-8cdc64cbe4b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581060394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5453ee9efa446ac99e294561ec2f170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped8e9322-db", "ovs_interfaceid": "ed8e9322-db71-4892-b133-e74dcbe2968a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_vif [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped8e9322-db, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:21 user nova-compute[73110]: INFO os_vif [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:49:4f,bridge_name='br-int',has_traffic_filtering=True,id=ed8e9322-db71-4892-b133-e74dcbe2968a,network=Network(4625951b-6d36-4501-99da-8cdc64cbe4b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped8e9322-db')
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDQAlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updated VIF entry in instance network info cache for port 5fa9fdc0-cb64-4b32-967a-1e9ad346739e. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating instance_info_cache with network_info: [{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Releasing lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-c03711e7-3f1e-4d58-a025-868e277d285b req-e2e11cdb-199f-4ecd-9872-1c7bbf7c0d99 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: WARNING nova.compute.manager [req-391368e7-af2e-4391-8258-42b13a0bd798 req-249e2a32-7e01-4847-89fe-58861a3e4145 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e for instance with vm_state building and task_state spawning.
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26535306535626633', 'path': '/dev/sdf'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535306535626633', 'path': '/dev/sdf'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.855s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-unplugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] No waiting events found dispatching network-vif-unplugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-unplugged-ed8e9322-db71-4892-b133-e74dcbe2968a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Acquiring lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] Lock "c66c6639-1168-477d-9f15-30e31cbb2369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] No waiting events found dispatching network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:22 user nova-compute[73110]: WARNING nova.compute.manager [req-0d7e5f30-ebeb-466e-97e1-2c563463e57c req-ee86ae94-483f-49c7-8a63-4a00187164e6 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received unexpected event network-vif-plugged-ed8e9322-db71-4892-b133-e74dcbe2968a for instance with vm_state active and task_state deleting.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f4fb7e-31c9-4a81-89f9-8b7bac3f60f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:22 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:22 user nova-compute[73110]:   <source dev="/dev/sdf"/>
Aug 26 17:42:22 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:22 user nova-compute[73110]:   <serial>0de89c12-2d48-4021-9fac-fa17cf1aacc1</serial>
Aug 26 17:42:22 user nova-compute[73110]: </disk>
Aug 26 17:42:22 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f86a6-7a9d-4a40-ba6d-0f3c57d2a432]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54461dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d7541d-b071-4559-98f3-4674b3398b4d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34058f39-bc85-4758-87c1-ba5684483ab6]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362855c-9598-4498-98fd-7ba0d629d9b3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad68879-7c87-405f-91ff-d520f6172284]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e3273-154a-4e69-9d04-671f3c7f777c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f73c288-8e59-4b81-8c00-1394feb11e6d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260]
Aug 26 17:42:22 user nova-compute[73110]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98718efd-f8aa-4477-bbee-aec7421581e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d441d985-0fd7-452f-8caa-77a35f7aa25a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] <== disconnect_volume: return (1168ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Deleting instance files /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369_del
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Deletion of /opt/stack/data/nova/instances/c66c6639-1168-477d-9f15-30e31cbb2369_del complete
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071742.3330977, 0611d638-abf0-45f2-8708-1cc2790ffe99 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] VM Resumed (Lifecycle Event)
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance spawned successfully.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071742.3346088, 0611d638-abf0-45f2-8708-1cc2790ffe99 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] VM Started (Lifecycle Event)
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Took 2.17 seconds to destroy the instance on the hypervisor.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No VIF found with MAC fa:16:3e:ee:a0:36, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Took 11.32 seconds to spawn the instance on the hypervisor.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-91184daa-0fbd-4a9a-9448-e6e4be01fc66 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.514s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:22 user nova-compute[73110]: INFO nova.compute.manager [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Took 49.27 seconds to build instance.
Aug 26 17:42:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d415a0ec-4170-40f3-aca2-4e014cd606d5 tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.380s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:23 user nova-compute[73110]: WARNING nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a for instance with vm_state active and task_state None.
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:23 user nova-compute[73110]: WARNING nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a for instance with vm_state active and task_state None.
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:23 user nova-compute[73110]: WARNING nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 for instance with vm_state active and task_state None.
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:23 user nova-compute[73110]: WARNING nova.compute.manager [req-a96e5a72-0745-4c79-a6de-da4171ee0aeb req-4c0586c9-03cd-4d04-9493-acf5d328e6fb service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 for instance with vm_state active and task_state None.
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:23 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Took 0.76 seconds to deallocate network for instance.
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73110) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-af82d414-4ef6-4ba9-82c2-0606cc4150fc req-47d9457a-0141-4f10-bac2-da459c9dee35 service nova] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Received event network-vif-deleted-ed8e9322-db71-4892-b133-e74dcbe2968a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:24 user nova-compute[73110]: INFO nova.compute.manager [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Took 0.91 seconds to detach 1 volumes for instance.
Aug 26 17:42:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance destroyed successfully.
Aug 26 17:42:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-388407ab-9ef5-4ee0-930f-6c21b9585259 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.910s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'flavor' on Instance uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.867s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:25 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Deleted allocations for instance c66c6639-1168-477d-9f15-30e31cbb2369
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4d656521-fea2-4d68-bb8b-1bed3b6e6ad2 tempest-DeleteServersTestJSON-618857684 tempest-DeleteServersTestJSON-618857684-project-member] Lock "c66c6639-1168-477d-9f15-30e31cbb2369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.948s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:25 user nova-compute[73110]: WARNING nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state stopped and task_state None.
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:25 user nova-compute[73110]: WARNING nova.compute.manager [req-d813df96-d1b2-49eb-aa51-37a217f67303 req-a31ad9b2-2006-497b-a01f-b8047150b979 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state stopped and task_state None.
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:25 user nova-compute[73110]: INFO nova.compute.manager [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Attaching volume bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 to /dev/vdb
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.utils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd14237-e962-40f8-97b6-f356ae9e847f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6696b7a-7066-4b47-be71-879d89a06a35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e6da6e-1472-4ac5-943d-6804cb57cfc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e418bf-4dcd-4460-a534-d85c518b9921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:25 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb2b9b-a11f-4960-ac22-95b30fd18597]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG os_brick.utils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:25 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating existing volume attachment record: 5d073971-3fd7-4d83-b969-687410614b54 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-changed-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Refreshing instance network info cache due to event network-changed-767cc0c4-e285-4682-b7c2-2cad845a0ddf. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] Acquiring lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] Acquired lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Refreshing network info cache for port 767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updated VIF entry in instance network info cache for port 767cc0c4-e285-4682-b7c2-2cad845a0ddf. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updating instance_info_cache with network_info: [{"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f260c2e-b830-4f09-a6bb-e60c19b7eb38 req-dd28ad7f-dfa9-4b27-bf21-e2bec3bda46c service nova] Releasing lock "refresh_cache-9c5fcd4b-2df1-485e-a979-30fda49229b3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received event network-changed-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Refreshing instance network info cache due to event network-changed-ae34facd-388b-4be1-952c-0b491b39b805. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] Acquiring lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] Acquired lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Refreshing network info cache for port ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lazy-loading 'flavor' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updated VIF entry in instance network info cache for port ae34facd-388b-4be1-952c-0b491b39b805. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updating instance_info_cache with network_info: [{"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:31 user nova-compute[73110]: INFO nova.compute.manager [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attaching volume 3c583d07-6bf8-4183-8707-20f3bea03261 to /dev/vdb
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff2aeff2-8994-43a2-b89c-6076adcfaaa8 req-c16e7652-e479-48dd-bc69-b1713e850830 service nova] Releasing lock "refresh_cache-3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7afc932-6ed7-4311-8496-8badad8bfb87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c5789-3948-43c6-9b42-bb272d8ff8d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d96ba-43c0-42ca-a699-4c3a75aed90f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e19f329-11cb-4f8c-873d-a3998e810ba1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:31 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c09e15-f955-41f3-af81-753c5cbd6ff1]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:31 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updating existing volume attachment record: 98ee6802-0835-4133-862f-95632adc858e {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lazy-loading 'flavor' on Instance uuid 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:33 user nova-compute[73110]: INFO nova.compute.manager [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Attaching volume 3228bf4f-fa0f-4700-8d62-b598619d23cd to /dev/sdc
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.utils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa1cc73-e32b-4566-b5bd-790446796834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f06400-e997-4b5f-bab4-40011daa9358]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f87610-bcfb-484a-a06d-ef0e9d3690d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a075393-0968-45e4-aca4-c67b81c4e680]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:33 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d404da9-cca1-461c-8839-77dd72353a4e]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG os_brick.utils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updating existing volume attachment record: b0033b6b-842d-420f-8742-ba17a4a00446 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-changed-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing instance network info cache due to event network-changed-e1957e20-b950-410f-9f65-3fb54406a445. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:34 user nova-compute[73110]: DEBUG nova.network.neutron [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing network info cache for port e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'flavor' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updated VIF entry in instance network info cache for port e1957e20-b950-410f-9f65-3fb54406a445. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-04b7b0cc-d34c-4736-a976-1d631a5bfb62 req-3e95ce1d-833a-414d-b4d6-7a1dbf622e29 service nova] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'pci_requests' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.objects.base [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Object Instance<fc65c329-e780-4927-994c-defa1e9d4ea7> lazy-loaded attributes: flavor,pci_requests {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:42:35 user nova-compute[73110]: DEBUG nova.policy [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e86694272e4435b371b0bcfcf0ba7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2a980cd25b4845bc65840a49e61437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:42:36 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071741.033496, c66c6639-1168-477d-9f15-30e31cbb2369 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:42:36 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] VM Stopped (Lifecycle Event)
Aug 26 17:42:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6abd840d-3bad-47f5-a14e-882d8ce9b722 None None] [instance: c66c6639-1168-477d-9f15-30e31cbb2369] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Successfully created port: b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-changed-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Refreshing instance network info cache due to event network-changed-90bc7b8b-188a-4c3d-83ca-cb93169628bc. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] Acquiring lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] Acquired lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.network.neutron [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Refreshing network info cache for port 90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Successfully updated port: b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-changed-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing instance network info cache due to event network-changed-b418d514-f1df-46d2-9826-40f762da2b01. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXyVNrYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:37 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e9886c-44d6-4a33-850f-d477ebae4bc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:37 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd361c-77c6-4ed7-bfc0-d43ea205495d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5] added
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53264aa-c547-4a5d-ac81-5f69307f5ef0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc831ab2-f0dc-4238-bf05-9c0bea1190ea]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXyVNrYo {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXyVNrYo" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1179fb-f7a6-448a-90c7-79eb5047dc22]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zXyVNrYo'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7aecc8-1c6e-4881-ab72-97bf0bcae1bd]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb3dcd-0b45-432f-b057-91003ee68f4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ca4ef-1266-4904-ab47-5a23f7bde811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260]
Aug 26 17:42:38 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lazy-loading 'flavor' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f8062-4c59-4374-926d-7293e7ed7f96]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfd76b-c937-47f5-8848-ccb8b0c99536]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9156aa-9431-411d-88ce-93fb28a6e0d3]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXyVNrYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updated VIF entry in instance network info cache for port 90bc7b8b-188a-4c3d-83ca-cb93169628bc. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updating instance_info_cache with network_info: [{"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:38 user nova-compute[73110]: INFO nova.compute.manager [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Attaching volume 8ec6508f-4197-4c25-a562-753f5c8067d8 to /dev/vdb
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8ce86e90-d5de-4bff-98e8-a8f84deef538 req-045299ae-59b2-4950-8ed0-47b2e07eebf4 service nova] Releasing lock "refresh_cache-66e24787-eb7a-48f9-85bc-b99392dc21a8" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.utils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee44d42-d71c-4e71-93dc-6473264fb03a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.119s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f059f-0b1d-46c0-8c6f-f4e50b78af99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccbfa8-93e7-4b97-adee-4012450d7a4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6bb31c-21ff-495b-8e84-dd0e36d6d044]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:38 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a56d8-113f-4d1f-acdf-31bb428e2ba7]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_brick.utils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updating existing volume attachment record: b2fdc286-694f-4929-ac11-73b0a3d91162 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Refreshing network info cache for port b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG os_vif [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb418d514-f1, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb418d514-f1, col_values=(('external_ids', {'iface-id': 'b418d514-f1df-46d2-9826-40f762da2b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:38:49', 'vm-uuid': 'fc65c329-e780-4927-994c-defa1e9d4ea7'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: INFO os_vif [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1')
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] attach device xml: <interface type="ethernet">
Aug 26 17:42:39 user nova-compute[73110]:   <mac address="fa:16:3e:ca:38:49"/>
Aug 26 17:42:39 user nova-compute[73110]:   <model type="virtio"/>
Aug 26 17:42:39 user nova-compute[73110]:   <mtu size="1442"/>
Aug 26 17:42:39 user nova-compute[73110]:   <target dev="tapb418d514-f1"/>
Aug 26 17:42:39 user nova-compute[73110]: </interface>
Aug 26 17:42:39 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071744.16877, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:42:39 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Stopped (Lifecycle Event)
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a5f1d55e-8771-4e5d-989f-b8e57ce02153 None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a5f1d55e-8771-4e5d-989f-b8e57ce02153 None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26662633233316364', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662633233316364', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'flavor' on Instance uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:39 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:39 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:39 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:39 user nova-compute[73110]:   <serial>bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5</serial>
Aug 26 17:42:39 user nova-compute[73110]: </disk>
Aug 26 17:42:39 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name hda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No VIF found with MAC fa:16:3e:2f:f7:82, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:42:39 user nova-compute[73110]:   <nova:package version="0.0.0"/>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:name>tempest-device-tagging-server-608315562</nova:name>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:creationTime>2023-08-26 17:42:39</nova:creationTime>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:flavor name="m1.tiny">
Aug 26 17:42:39 user nova-compute[73110]:     <nova:memory>512</nova:memory>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:disk>1</nova:disk>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:swap>0</nova:swap>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:vcpus>1</nova:vcpus>
Aug 26 17:42:39 user nova-compute[73110]:   </nova:flavor>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:owner>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:user uuid="78e86694272e4435b371b0bcfcf0ba7a">tempest-TaggedAttachmentsTest-646385816-project-member</nova:user>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:project uuid="dc2a980cd25b4845bc65840a49e61437">tempest-TaggedAttachmentsTest-646385816</nova:project>
Aug 26 17:42:39 user nova-compute[73110]:   </nova:owner>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:42:39 user nova-compute[73110]:   <nova:ports>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:port uuid="e1957e20-b950-410f-9f65-3fb54406a445">
Aug 26 17:42:39 user nova-compute[73110]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:42:39 user nova-compute[73110]:     </nova:port>
Aug 26 17:42:39 user nova-compute[73110]:     <nova:port uuid="b418d514-f1df-46d2-9826-40f762da2b01">
Aug 26 17:42:39 user nova-compute[73110]:       <nova:ip type="fixed" address="10.10.10.216" ipVersion="4"/>
Aug 26 17:42:39 user nova-compute[73110]:     </nova:port>
Aug 26 17:42:39 user nova-compute[73110]:   </nova:ports>
Aug 26 17:42:39 user nova-compute[73110]: </nova:instance>
Aug 26 17:42:39 user nova-compute[73110]:  {{(pid=73110) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:39 user nova-compute[73110]: WARNING nova.compute.manager [req-4b5b1516-6f80-4f9e-ae8a-30a022b7c426 req-4bc7313e-90b6-4200-80dd-d3a148e93805 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 for instance with vm_state active and task_state None.
Aug 26 17:42:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ec1df3f-e4a3-4079-9b79-01cb03205a59 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.254s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.network.neutron [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updated VIF entry in instance network info cache for port b418d514-f1df-46d2-9826-40f762da2b01. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG nova.network.neutron [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dd3b5d09-2efa-4b17-8f3e-12b7b8496879 req-37d66a34-13a2-45a3-be93-7fd031cd2a5a service nova] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No VIF found with MAC fa:16:3e:eb:0c:ff, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:41 user nova-compute[73110]: WARNING nova.compute.manager [req-0202dd36-fd1a-4d4d-acde-1ea717c8cb2d req-3d5e59ca-a55d-41f4-8e6c-ccde80ee9180 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 for instance with vm_state active and task_state None.
Aug 26 17:42:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:45 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:45 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:45 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ba61e-ee9a-4808-83f5-488831856dcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:45 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[96455756-c588-43c9-87be-026f835870f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261] added
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f503dfb8-fd56-4c5c-ac8c-90977efcf867]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe344964-eaf1-4f31-8b08-6b059649bbe3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPUeuqt {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPUeuqt" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa7d25-61c1-42c7-9e60-c587bf4eef39]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZaPUeuqt'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ecf14f-fb38-4cc4-afbc-c6a88e27e91e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88cd3c-9df3-4dab-9b17-ff8bf8c94706]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7fbd8-30b7-4bde-808b-ee1659fde54e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]
Aug 26 17:42:45 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e04291d-b11d-4c94-9cbe-971781caa9f4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'flavor' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5bf07b-c80e-4294-9d39-f55d08a71409]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae819ad-40d4-4796-b034-d782756f1a68]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f9a5dd6-3f44-44df-b48f-c273d00ddd57 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.388s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:45 user nova-compute[73110]: INFO nova.compute.manager [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Attaching volume 5f368962-31b9-4700-bc6c-94792a91e2ee to /dev/vdb
Aug 26 17:42:45 user nova-compute[73110]: DEBUG os_brick.utils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b93691-54d6-428a-9042-f7344b1c8bd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e310f-caea-4605-aba1-94c33788a430]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce246cd5-5f14-4afc-b4bd-bbf3905be327]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[57693bb9-eb4e-4768-80a9-4292a38ac621]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:46 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c8cec-dda3-439e-9d96-c2b2163fc49d]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.utils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating existing volume attachment record: d2c46519-f518-4ad5-af4f-90bee6b1790c {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26530356462613965', 'path': '/dev/sdg'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530356462613965', 'path': '/dev/sdg'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lazy-loading 'flavor' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:46 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:46 user nova-compute[73110]:   <source dev="/dev/sdg"/>
Aug 26 17:42:46 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:46 user nova-compute[73110]:   <serial>3c583d07-6bf8-4183-8707-20f3bea03261</serial>
Aug 26 17:42:46 user nova-compute[73110]: </disk>
Aug 26 17:42:46 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqHQUvMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:47 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:47 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:47 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a215e-3e7c-4a9b-9d63-20396f4b8f05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:47 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a189bd-41b8-47e0-9d49-e87a9b3c46e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd] added
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[017abe34-82d0-4c05-a585-54676ba60b60]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a30ea27-ae41-4a05-9b7f-49f8c546af3a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqHQUvMJ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqHQUvMJ" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c112b-d21a-4831-be6a-b41b695604a1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KqHQUvMJ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8a2ab-b634-472e-b64b-549853678dda]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] No VIF found with MAC fa:16:3e:8c:a9:23, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a533e1-6913-4f59-9ab4-24b6a8820dc9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc421925-0c79-41ca-bae4-fd2ae445a9c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260]
Aug 26 17:42:47 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e8de98-d192-46ea-8b3b-ad3986dcbd3a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d48b18-740c-4a7f-bb82-e777e77981d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:47 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:47 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da38a3-34fa-477a-a813-d552d627ff55]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqHQUvMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-be24c264-67fd-4c09-b78f-5f2858573461 tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.249s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:48 user nova-compute[73110]: INFO nova.compute.manager [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Detaching volume bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:48 user nova-compute[73110]: INFO nova.virt.block_device [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Attempting to driver detach volume bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 from mountpoint /dev/vdb
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Attempting to detach device vdb from instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:48 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:48 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:48 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:48 user nova-compute[73110]:   <serial>bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5</serial>
Aug 26 17:42:48 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:42:48 user nova-compute[73110]: </disk>
Aug 26 17:42:48 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully detached device vdb from instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 from the persistent domain config.
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:48 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:48 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:48 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:48 user nova-compute[73110]:   <serial>bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5</serial>
Aug 26 17:42:48 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:42:48 user nova-compute[73110]: </disk>
Aug 26 17:42:48 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23838353961626563', 'path': '/dev/sdh'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838353961626563', 'path': '/dev/sdh'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lazy-loading 'flavor' on Instance uuid 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:48 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:48 user nova-compute[73110]:   <source dev="/dev/sdh"/>
Aug 26 17:42:48 user nova-compute[73110]:   <target dev="sdc" bus="scsi"/>
Aug 26 17:42:48 user nova-compute[73110]:   <serial>3228bf4f-fa0f-4700-8d62-b598619d23cd</serial>
Aug 26 17:42:48 user nova-compute[73110]:   <address type="drive" controller="0" unit="2"/>
Aug 26 17:42:48 user nova-compute[73110]: </disk>
Aug 26 17:42:48 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071768.779968, 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:42:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully detached device vdb from instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 from the live domain config.
Aug 26 17:42:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXyVNrYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:48 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad0446-9d55-40c2-bfd0-c3fd34cb925e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.utils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d35e89-49e4-4741-9949-5055f4b1386d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:48 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:48 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:48 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd573bd03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b7766-e431-4b5b-85e3-1b72166e88af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62f67e-1e73-4ee6-a91e-362d33319c92]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.043s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e41f4-08a6-40c0-bfe5-81c7af3da2c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d1524-c960-480d-9bb4-69ebee103f1b]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d43dac-de26-4514-af1d-e4d3d57c4645]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8df34-ba08-466f-b30a-0b65727b2e36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b28db7-3d65-4783-9e75-e49312ca0b02]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:42:49 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d339572-39af-4ebe-86f8-189a2ea857b0]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.utils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c888f530-4577-4ccb-9736-d69a3b45efcb]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a215f1a7-1d14-4387-a468-34d1750cfc32]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: INFO nova.compute.manager [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Swapping volume 3c583d07-6bf8-4183-8707-20f3bea03261 for 8195e257-f149-489b-ab0d-47723afb7cc0
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[60974d82-1459-41b4-a43b-d28315eda0ad]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260]
Aug 26 17:42:49 user nova-compute[73110]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:49 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9fa99a-1dcb-491c-a54a-f1606ebe2ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ebd21-94ab-4161-81ad-e4895728c45d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] <== disconnect_volume: return (458ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No BDM found with device name sda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] No VIF found with MAC fa:16:3e:74:98:2f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRvwxImM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:52 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:52 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:52 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7989539-db4d-4ed0-bbc2-ce4b67dab87b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:52 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f339fb2-8ac8-414a-9839-d55f45bf2dd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8] added
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f0814-2c1b-4650-a7fd-d0d96414b763]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc5c17-52df-4e6d-97a3-882c23fe7077]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRvwxImM {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRvwxImM" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d36274-8ee6-4cb3-8253-b2402bc961d7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bRvwxImM'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98163b-11cf-4423-a4e1-e260e2205d3c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[43630a5a-52e2-4819-aef5-cb18a9342656]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd96856b-ac45-42b0-83c5-485297066e22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260]
Aug 26 17:42:52 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd41b3-a117-437a-abfb-b1bd1a4ed004]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f008be-1c41-45cb-b6ef-5fc97096db97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:52 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a80da-50f7-4a5b-a2e0-999bbff5f2d2]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG nova.objects.instance [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'flavor' on Instance uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44250730-c7eb-4513-b261-f7009234a73f tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.089s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0f6558cc-7e1c-46cc-b7b1-731a6a72a25c tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.196s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRvwxImM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23263633931346464', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263633931346464', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lazy-loading 'flavor' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 17:42:53 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:53 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:53 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:53 user nova-compute[73110]:   <serial>8ec6508f-4197-4c25-a562-753f5c8067d8</serial>
Aug 26 17:42:53 user nova-compute[73110]: </disk>
Aug 26 17:42:53 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:54 user nova-compute[73110]: INFO nova.compute.manager [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Detaching volume 3228bf4f-fa0f-4700-8d62-b598619d23cd
Aug 26 17:42:54 user nova-compute[73110]: INFO nova.virt.block_device [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Attempting to driver detach volume 3228bf4f-fa0f-4700-8d62-b598619d23cd from mountpoint /dev/sdc
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Attempting to detach device sdc from instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:54 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:54 user nova-compute[73110]:   <source dev="/dev/sdh"/>
Aug 26 17:42:54 user nova-compute[73110]:   <target dev="sdc" bus="scsi"/>
Aug 26 17:42:54 user nova-compute[73110]:   <serial>3228bf4f-fa0f-4700-8d62-b598619d23cd</serial>
Aug 26 17:42:54 user nova-compute[73110]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 17:42:54 user nova-compute[73110]: </disk>
Aug 26 17:42:54 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] No VIF found with MAC fa:16:3e:f9:0b:7f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Successfully detached device sdc from instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 from the persistent domain config.
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:54 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:54 user nova-compute[73110]:   <source dev="/dev/sdh"/>
Aug 26 17:42:54 user nova-compute[73110]:   <target dev="sdc" bus="scsi"/>
Aug 26 17:42:54 user nova-compute[73110]:   <serial>3228bf4f-fa0f-4700-8d62-b598619d23cd</serial>
Aug 26 17:42:54 user nova-compute[73110]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 17:42:54 user nova-compute[73110]: </disk>
Aug 26 17:42:54 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3a69d561-ec5c-4daa-b4fa-dd49afd53d79 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.016s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071774.8539333, 9c5fcd4b-2df1-485e-a979-30fda49229b3 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:42:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Successfully detached device sdc from instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 from the live domain config.
Aug 26 17:42:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqHQUvMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:54 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbd801-9ee0-4201-b50c-fd72b1ae4324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e596655-158b-4412-81a2-c88dd6f5ba3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:54 user nova-compute[73110]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd (non-flash)
Aug 26 17:42:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd56428f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd'): ({'sdh'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Removing single pathed devices sdh {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e812d02-64e2-4783-9882-54500c122b30]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd492ab-cad9-4594-b854-5871d33241cc]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Flushing IO for device /dev/sdh {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5c8b8-e6d0-47c5-8900-eddba3b7434e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[614bf89c-a704-473a-80d5-2815e8cdf2d0]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69210abd-ed72-43db-ada0-3636b1adea37]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2762a0e-1810-4d8d-9bca-ca6a6f546e35]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260]
Aug 26 17:42:55 user nova-compute[73110]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3228bf4f-fa0f-4700-8d62-b598619d23cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[667f0d8a-e3e0-44dc-bd80-ed2e36238614]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] <== disconnect_volume: return (316ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.objects.instance [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lazy-loading 'flavor' on Instance uuid 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-19d624d3-8888-4864-a8cb-515533501757 tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.954s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] volume_snapshot_create: create_info: {'snapshot_id': 'db3f0bba-b8b4-4134-aa50-cf8e4748d33f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73110) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-85d43288-fb6e-466c-a001-739b1a4c0688 tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] volume_snapshot_delete: delete_info: {'volume_id': '8ec6508f-4197-4c25-a562-753f5c8067d8'} {{(pid=73110) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [None req-85d43288-fb6e-466c-a001-739b1a4c0688 tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     if delete_info['type'] != 'qcow2':
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] KeyError: 'type'
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] 
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] snap xml: <domainsnapshot>
Aug 26 17:42:56 user nova-compute[73110]:   <disks>
Aug 26 17:42:56 user nova-compute[73110]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 26 17:42:56 user nova-compute[73110]:       <source file="/dev/new_file"/>
Aug 26 17:42:56 user nova-compute[73110]:     </disk>
Aug 26 17:42:56 user nova-compute[73110]:     <disk name="vda" snapshot="no"/>
Aug 26 17:42:56 user nova-compute[73110]:   </disks>
Aug 26 17:42:56 user nova-compute[73110]: </domainsnapshot>
Aug 26 17:42:56 user nova-compute[73110]:  {{(pid=73110) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.objects.instance [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] Lazy-loading 'system_metadata' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:56 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:42:56 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7230MB free_disk=25.53508758544922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:56 user nova-compute[73110]: INFO nova.compute.manager [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Terminating instance
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:42:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     rv = execute(f, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     six.reraise(c, e, tb)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     raise value
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     rv = meth(*args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     self._volume_snapshot_create(context, instance, guest,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     rv = execute(f, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     six.reraise(c, e, tb)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     raise value
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     rv = meth(*args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [None req-85d43288-fb6e-466c-a001-739b1a4c0688 tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-dbbc0a36-cc55-4bf7-85db-fe09829cebaa)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 17:42:56 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server [None req-85d43288-fb6e-466c-a001-739b1a4c0688 tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] Exception during message handling: KeyError: 'type'
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 17:42:56 user nova-compute[73110]: ERROR oslo_messaging.rpc.server 
Aug 26 17:42:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9c5fcd4b-2df1-485e-a979-30fda49229b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance fc65c329-e780-4927-994c-defa1e9d4ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0611d638-abf0-45f2-8708-1cc2790ffe99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:42:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot db3f0bba-b8b4-4134-aa50-cf8e4748d33f could not be found.
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot db3f0bba-b8b4-4134-aa50-cf8e4748d33f could not be found. (HTTP 404) (Request-ID: req-6fc5312d-3bdd-49a6-ab6c-9ed9940fecb3)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot db3f0bba-b8b4-4134-aa50-cf8e4748d33f could not be found.
Aug 26 17:42:57 user nova-compute[73110]: ERROR nova.virt.libvirt.driver 
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server [None req-32fabbb1-1a3b-4a9d-ba1b-a3e6e3e255fa tempest-VolumesAssistedSnapshotsTest-1664955351 tempest-VolumesAssistedSnapshotsTest-1664955351-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 17:42:57 user nova-compute[73110]: ERROR oslo_messaging.rpc.server 
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.compute.manager [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Detaching volume 8ec6508f-4197-4c25-a562-753f5c8067d8
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-unplugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] No waiting events found dispatching network-vif-unplugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-f56f8d1d-112f-49b0-9056-8e4390036820 req-04c18ce4-ad78-4304-b1ad-b236ac507ea9 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-unplugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.block_device [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Attempting to driver detach volume 8ec6508f-4197-4c25-a562-753f5c8067d8 from mountpoint /dev/vdb
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Attempting to detach device vdb from instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:57 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:57 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:57 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:57 user nova-compute[73110]:   <serial>8ec6508f-4197-4c25-a562-753f5c8067d8</serial>
Aug 26 17:42:57 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:42:57 user nova-compute[73110]: </disk>
Aug 26 17:42:57 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Successfully detached device vdb from instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 from the persistent domain config.
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 17:42:57 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:42:57 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:42:57 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:42:57 user nova-compute[73110]:   <serial>8ec6508f-4197-4c25-a562-753f5c8067d8</serial>
Aug 26 17:42:57 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:42:57 user nova-compute[73110]: </disk>
Aug 26 17:42:57 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071777.8483188, 66e24787-eb7a-48f9-85bc-b99392dc21a8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Successfully detached device vdb from instance 66e24787-eb7a-48f9-85bc-b99392dc21a8 from the live domain config.
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRvwxImM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:57 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Instance destroyed successfully.
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.objects.instance [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lazy-loading 'resources' on Instance uuid 9c5fcd4b-2df1-485e-a979-30fda49229b3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1373177481',display_name='tempest-AttachSCSIVolumeTestJSON-server-1373177481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1373177481',id=7,image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbaRhWbgy00E1Y3jo/4XrbdZxexNXm6CCOGziesaQjSLEs8Yo7YFAaYQ+BddrE7exkU1XmXmMsH9sbX/2k0Jo6x7MMy1yELu7kY4yeHsCuqU3lh08q41X50K7OmvDs0gw==',key_name='tempest-keypair-1315577117',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1978b0cd4f4765bad982b13a27b7e2',ramdisk_id='',reservation_id='r-0ocygk00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce8e00e-612e-4ad0-9d17-f948a832ca7f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-756870323',owner_user_name='tempest-AttachSCSIVolumeTestJSON-756870323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d939fc60c0248d3a860e2a0686ac121',uuid=9c5fcd4b-2df1-485e-a979-30fda49229b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converting VIF {"id": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "address": "fa:16:3e:74:98:2f", "network": {"id": "70ce9ca0-e193-4003-952a-23d44cad8b73", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1740902843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1978b0cd4f4765bad982b13a27b7e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767cc0c4-e2", "ovs_interfaceid": "767cc0c4-e285-4682-b7c2-2cad845a0ddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_vif [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap767cc0c4-e2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[505adf0b-82fe-4ddc-b51b-e9e0e158e00e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:57 user nova-compute[73110]: INFO os_vif [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=767cc0c4-e285-4682-b7c2-2cad845a0ddf,network=Network(70ce9ca0-e193-4003-952a-23d44cad8b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767cc0c4-e2')
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Deleting instance files /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3_del
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Deletion of /opt/stack/data/nova/instances/9c5fcd4b-2df1-485e-a979-30fda49229b3_del complete
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb429d-8b9d-41f6-9b6e-525a88b8e86e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:57 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54420af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f4757-0664-4e07-af05-5d667ec91202]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:57 user nova-compute[73110]: INFO nova.compute.manager [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 17:42:57 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:42:57 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc58e82-a349-414b-a176-32b4064cc89d]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f1f46-a776-47a1-9b11-1cf49bea06f5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dea39d-41d5-4590-a18d-d3ff87466b5b]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97818128-ace0-4453-b7ad-8468d5b4cc8d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b1ff1-85aa-4533-bfe0-538ac33679bd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260]
Aug 26 17:42:58 user nova-compute[73110]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec6508f-4197-4c25-a562-753f5c8067d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b9bd64-8983-48ba-b0ef-a0a339d07ef7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] <== disconnect_volume: return (338ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:42:58 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:42:59 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Took 1.03 seconds to deallocate network for instance.
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVOxHskg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:42:59 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:59 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:42:59 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3798d45f-a101-4d78-8300-0d0b2163f4d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:42:59 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lazy-loading 'flavor' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[46073d77-1c29-4fb3-b988-bc4997826166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee] added
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73027f6-113e-42ef-abd2-5c31e62d70ba]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5828f452-9341-4210-b621-5efdb8527195 tempest-VolumesAssistedSnapshotsTest-2138719737 tempest-VolumesAssistedSnapshotsTest-2138719737-project-admin] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.043s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[27296409-e089-43dc-a263-c46b01d921d4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVOxHskg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVOxHskg" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e572b1-49f5-413b-a6d1-8ffef78d8aee]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QVOxHskg'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17209389-5c22-43be-89d3-a259aeebce50]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[052da694-ee6d-4895-9da2-376b28a49c1e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] Acquiring lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] No waiting events found dispatching network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:42:59 user nova-compute[73110]: WARNING nova.compute.manager [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received unexpected event network-vif-plugged-767cc0c4-e285-4682-b7c2-2cad845a0ddf for instance with vm_state deleted and task_state None.
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab1a4d67-c3fc-4578-9d8e-bf4c3427e7f6 req-6856497d-65e0-491f-87b7-9f722e22bf62 service nova] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Received event network-vif-deleted-767cc0c4-e285-4682-b7c2-2cad845a0ddf {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0754d083-67e1-47a8-83bc-26a26e84aa27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260]
Aug 26 17:42:59 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260] successful.
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b12c59c-08f8-46a1-a633-0ffca053d31f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a37dfa8-e4cb-4c2d-8cad-7f39bbf78a81]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:42:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f64568-5eeb-4fd7-a82f-5bf16417cc3b]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVOxHskg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:42:59 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Deleted allocations for instance 9c5fcd4b-2df1-485e-a979-30fda49229b3
Aug 26 17:42:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-604c84ef-d193-4d4e-97a7-b3f9296f8cde tempest-AttachSCSIVolumeTestJSON-756870323 tempest-AttachSCSIVolumeTestJSON-756870323-project-member] Lock "9c5fcd4b-2df1-485e-a979-30fda49229b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.876s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23064343166646161', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064343166646161', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'flavor' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:43:00 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:43:00 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:43:00 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:43:00 user nova-compute[73110]:   <serial>5f368962-31b9-4700-bc6c-94792a91e2ee</serial>
Aug 26 17:43:00 user nova-compute[73110]: </disk>
Aug 26 17:43:00 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No BDM found with device name hda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:43:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] No VIF found with MAC fa:16:3e:2f:f7:82, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:43:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9bc9768-2b6d-4971-ab56-71cc8eeff69f tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.213s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0', 'serial': '8195e257-f149-489b-ab0d-47723afb7cc0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '3c583d07-6bf8-4183-8707-20f3bea03261', 'serial'} {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:02 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96ad6a-9fc8-4845-b6be-f92cac1328e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:43:02 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2ba73-f208-43ad-9b54-f3524814fa98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0] added
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a54976c-3729-4de9-859f-3b98ee6ed275]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937a2a0-110d-46b9-9d28-e74165ef4bc2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYhHGtEU {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYhHGtEU" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2297fde6-dc3a-466f-97f1-7a9d11aa2fa2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYhHGtEU'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9811b0-f645-4780-8195-6d01a80ddacf]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a474189-979c-44af-bcda-330d8ddbc6b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42597d-6987-40a0-bafe-454cbb93e56e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260]
Aug 26 17:43:02 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f488d4-d018-4113-a184-512577763d1f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcfe889-6938-4e13-9500-802af363b530]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:02 user nova-compute[73110]: INFO nova.compute.manager [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Detaching volume 5f368962-31b9-4700-bc6c-94792a91e2ee
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75a1ad-88f1-46f8-9759-f661868be2c4]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:43:02 user nova-compute[73110]: INFO nova.virt.block_device [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Attempting to driver detach volume 5f368962-31b9-4700-bc6c-94792a91e2ee from mountpoint /dev/vdb
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Attempting to detach device vdb from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:43:02 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:43:02 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:43:02 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:43:02 user nova-compute[73110]:   <serial>5f368962-31b9-4700-bc6c-94792a91e2ee</serial>
Aug 26 17:43:02 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:43:02 user nova-compute[73110]: </disk>
Aug 26 17:43:02 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully detached device vdb from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the persistent domain config.
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:43:02 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:43:02 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:43:02 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:43:02 user nova-compute[73110]:   <serial>5f368962-31b9-4700-bc6c-94792a91e2ee</serial>
Aug 26 17:43:02 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:43:02 user nova-compute[73110]: </disk>
Aug 26 17:43:02 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071782.9574864, fc65c329-e780-4927-994c-defa1e9d4ea7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:43:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully detached device vdb from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the live domain config.
Aug 26 17:43:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVOxHskg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26434666661356361', 'path': '/dev/sdh'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434666661356361', 'path': '/dev/sdh'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.461s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lazy-loading 'flavor' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[08216401-0671-4cf0-b804-3a94ee1fbd8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380e3ea-49bd-4825-92e5-39bd7031b230]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544704af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a71330-d7b2-4ada-ac3d-d305702dc6b2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a87702-1c9e-4169-8d5e-24c7471402d6]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e821d-8e03-4af9-b7b7-5e34ac72dadc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a788fc-84ca-4f13-bdff-c253f50a0b76]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f1c73-6ee6-4eb7-9887-968768d25ec6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9e595a-ad00-4796-b3c3-0c9117127364]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260]
Aug 26 17:43:03 user nova-compute[73110]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f368962-31b9-4700-bc6c-94792a91e2ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae296ed4-f87b-41f1-bcfb-ee8fbcef8640]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] <== disconnect_volume: return (807ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:43:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 120586240 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'flavor' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2918c24e-3711-4837-8e34-2ab860f8e2f9 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.613s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 467664896 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-b418d514-f1df-46d2-9826-40f762da2b01" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-b418d514-f1df-46d2-9826-40f762da2b01" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'flavor' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface> {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface> {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Attempting to detach device tapb418d514-f1 from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] detach device xml: <interface type="ethernet">
Aug 26 17:43:05 user nova-compute[73110]:   <mac address="fa:16:3e:ca:38:49"/>
Aug 26 17:43:05 user nova-compute[73110]:   <model type="virtio"/>
Aug 26 17:43:05 user nova-compute[73110]:   <mtu size="1442"/>
Aug 26 17:43:05 user nova-compute[73110]:   <target dev="tapb418d514-f1"/>
Aug 26 17:43:05 user nova-compute[73110]: </interface>
Aug 26 17:43:05 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface> {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 17:43:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 26 17:43:05 user nova-compute[73110]:   <name>instance-00000009</name>
Aug 26 17:43:05 user nova-compute[73110]:   <uuid>fc65c329-e780-4927-994c-defa1e9d4ea7</uuid>
Aug 26 17:43:05 user nova-compute[73110]:   <metadata>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:43:05 user nova-compute[73110]:   <nova:package version="0.0.0"/>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:name>tempest-device-tagging-server-608315562</nova:name>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:creationTime>2023-08-26 17:42:39</nova:creationTime>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:flavor name="m1.tiny">
Aug 26 17:43:05 user nova-compute[73110]:     <nova:memory>512</nova:memory>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:disk>1</nova:disk>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:swap>0</nova:swap>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:vcpus>1</nova:vcpus>
Aug 26 17:43:05 user nova-compute[73110]:   </nova:flavor>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:owner>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:user uuid="78e86694272e4435b371b0bcfcf0ba7a">tempest-TaggedAttachmentsTest-646385816-project-member</nova:user>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:project uuid="dc2a980cd25b4845bc65840a49e61437">tempest-TaggedAttachmentsTest-646385816</nova:project>
Aug 26 17:43:05 user nova-compute[73110]:   </nova:owner>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:43:05 user nova-compute[73110]:   <nova:ports>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:port uuid="e1957e20-b950-410f-9f65-3fb54406a445">
Aug 26 17:43:05 user nova-compute[73110]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:43:05 user nova-compute[73110]:     </nova:port>
Aug 26 17:43:05 user nova-compute[73110]:     <nova:port uuid="b418d514-f1df-46d2-9826-40f762da2b01">
Aug 26 17:43:05 user nova-compute[73110]:       <nova:ip type="fixed" address="10.10.10.216" ipVersion="4"/>
Aug 26 17:43:05 user nova-compute[73110]:     </nova:port>
Aug 26 17:43:05 user nova-compute[73110]:   </nova:ports>
Aug 26 17:43:05 user nova-compute[73110]: </nova:instance>
Aug 26 17:43:05 user nova-compute[73110]:   </metadata>
Aug 26 17:43:05 user nova-compute[73110]:   <memory unit='KiB'>524288</memory>
Aug 26 17:43:05 user nova-compute[73110]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 17:43:05 user nova-compute[73110]:   <vcpu placement='static'>1</vcpu>
Aug 26 17:43:05 user nova-compute[73110]:   <resource>
Aug 26 17:43:05 user nova-compute[73110]:     <partition>/machine</partition>
Aug 26 17:43:05 user nova-compute[73110]:   </resource>
Aug 26 17:43:05 user nova-compute[73110]:   <sysinfo type='smbios'>
Aug 26 17:43:05 user nova-compute[73110]:     <system>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='version'>0.0.0</entry>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='serial'>fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='uuid'>fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:43:05 user nova-compute[73110]:       <entry name='family'>Virtual Machine</entry>
Aug 26 17:43:05 user nova-compute[73110]:     </system>
Aug 26 17:43:05 user nova-compute[73110]:   </sysinfo>
Aug 26 17:43:05 user nova-compute[73110]:   <os>
Aug 26 17:43:05 user nova-compute[73110]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 17:43:05 user nova-compute[73110]:     <boot dev='hd'/>
Aug 26 17:43:05 user nova-compute[73110]:     <smbios mode='sysinfo'/>
Aug 26 17:43:05 user nova-compute[73110]:   </os>
Aug 26 17:43:05 user nova-compute[73110]:   <features>
Aug 26 17:43:05 user nova-compute[73110]:     <acpi/>
Aug 26 17:43:05 user nova-compute[73110]:     <apic/>
Aug 26 17:43:05 user nova-compute[73110]:     <vmcoreinfo state='on'/>
Aug 26 17:43:05 user nova-compute[73110]:   </features>
Aug 26 17:43:05 user nova-compute[73110]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 17:43:05 user nova-compute[73110]:     <model fallback='forbid'>Nehalem</model>
Aug 26 17:43:05 user nova-compute[73110]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 17:43:05 user nova-compute[73110]:     <feature policy='require' name='vme'/>
Aug 26 17:43:05 user nova-compute[73110]:     <feature policy='require' name='x2apic'/>
Aug 26 17:43:05 user nova-compute[73110]:     <feature policy='require' name='hypervisor'/>
Aug 26 17:43:05 user nova-compute[73110]:   </cpu>
Aug 26 17:43:05 user nova-compute[73110]:   <clock offset='utc'>
Aug 26 17:43:05 user nova-compute[73110]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 17:43:05 user nova-compute[73110]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 17:43:05 user nova-compute[73110]:     <timer name='hpet' present='no'/>
Aug 26 17:43:05 user nova-compute[73110]:   </clock>
Aug 26 17:43:05 user nova-compute[73110]:   <on_poweroff>destroy</on_poweroff>
Aug 26 17:43:05 user nova-compute[73110]:   <on_reboot>restart</on_reboot>
Aug 26 17:43:05 user nova-compute[73110]:   <on_crash>destroy</on_crash>
Aug 26 17:43:05 user nova-compute[73110]:   <devices>
Aug 26 17:43:05 user nova-compute[73110]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 17:43:05 user nova-compute[73110]:     <disk type='file' device='disk'>
Aug 26 17:43:05 user nova-compute[73110]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 17:43:05 user nova-compute[73110]:       <source file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk' index='2'/>
Aug 26 17:43:05 user nova-compute[73110]:       <backingStore type='file' index='3'>
Aug 26 17:43:05 user nova-compute[73110]:         <format type='raw'/>
Aug 26 17:43:05 user nova-compute[73110]:         <source file='/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd'/>
Aug 26 17:43:05 user nova-compute[73110]:         <backingStore/>
Aug 26 17:43:05 user nova-compute[73110]:       </backingStore>
Aug 26 17:43:05 user nova-compute[73110]:       <target dev='vda' bus='virtio'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='virtio-disk0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </disk>
Aug 26 17:43:05 user nova-compute[73110]:     <disk type='file' device='cdrom'>
Aug 26 17:43:05 user nova-compute[73110]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 17:43:05 user nova-compute[73110]:       <source file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config' index='1'/>
Aug 26 17:43:05 user nova-compute[73110]:       <backingStore/>
Aug 26 17:43:05 user nova-compute[73110]:       <target dev='hda' bus='ide'/>
Aug 26 17:43:05 user nova-compute[73110]:       <readonly/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='ide0-0-0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </disk>
Aug 26 17:43:05 user nova-compute[73110]:     <controller type='usb' index='0' model='none'>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='usb'/>
Aug 26 17:43:05 user nova-compute[73110]:     </controller>
Aug 26 17:43:05 user nova-compute[73110]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='pci.0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </controller>
Aug 26 17:43:05 user nova-compute[73110]:     <controller type='ide' index='0'>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='ide'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 17:43:05 user nova-compute[73110]:     </controller>
Aug 26 17:43:05 user nova-compute[73110]:     <interface type='ethernet'>
Aug 26 17:43:05 user nova-compute[73110]:       <mac address='fa:16:3e:2f:f7:82'/>
Aug 26 17:43:05 user nova-compute[73110]:       <target dev='tape1957e20-b9'/>
Aug 26 17:43:05 user nova-compute[73110]:       <model type='virtio'/>
Aug 26 17:43:05 user nova-compute[73110]:       <mtu size='1442'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='net0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </interface>
Aug 26 17:43:05 user nova-compute[73110]:     <interface type='ethernet'>
Aug 26 17:43:05 user nova-compute[73110]:       <mac address='fa:16:3e:ca:38:49'/>
Aug 26 17:43:05 user nova-compute[73110]:       <target dev='tapb418d514-f1'/>
Aug 26 17:43:05 user nova-compute[73110]:       <model type='virtio'/>
Aug 26 17:43:05 user nova-compute[73110]:       <mtu size='1442'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='net1'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </interface>
Aug 26 17:43:05 user nova-compute[73110]:     <serial type='pty'>
Aug 26 17:43:05 user nova-compute[73110]:       <source path='/dev/pts/8'/>
Aug 26 17:43:05 user nova-compute[73110]:       <log file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log' append='off'/>
Aug 26 17:43:05 user nova-compute[73110]:       <target type='isa-serial' port='0'>
Aug 26 17:43:05 user nova-compute[73110]:         <model name='isa-serial'/>
Aug 26 17:43:05 user nova-compute[73110]:       </target>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='serial0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </serial>
Aug 26 17:43:05 user nova-compute[73110]:     <console type='pty' tty='/dev/pts/8'>
Aug 26 17:43:05 user nova-compute[73110]:       <source path='/dev/pts/8'/>
Aug 26 17:43:05 user nova-compute[73110]:       <log file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log' append='off'/>
Aug 26 17:43:05 user nova-compute[73110]:       <target type='serial' port='0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='serial0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </console>
Aug 26 17:43:05 user nova-compute[73110]:     <input type='mouse' bus='ps2'>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='input0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </input>
Aug 26 17:43:05 user nova-compute[73110]:     <input type='keyboard' bus='ps2'>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='input1'/>
Aug 26 17:43:05 user nova-compute[73110]:     </input>
Aug 26 17:43:05 user nova-compute[73110]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 26 17:43:05 user nova-compute[73110]:       <listen type='address' address='0.0.0.0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </graphics>
Aug 26 17:43:05 user nova-compute[73110]:     <audio id='1' type='none'/>
Aug 26 17:43:05 user nova-compute[73110]:     <video>
Aug 26 17:43:05 user nova-compute[73110]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='video0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </video>
Aug 26 17:43:05 user nova-compute[73110]:     <memballoon model='virtio'>
Aug 26 17:43:05 user nova-compute[73110]:       <stats period='10'/>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='balloon0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </memballoon>
Aug 26 17:43:05 user nova-compute[73110]:     <rng model='virtio'>
Aug 26 17:43:05 user nova-compute[73110]:       <backend model='random'>/dev/urandom</backend>
Aug 26 17:43:05 user nova-compute[73110]:       <alias name='rng0'/>
Aug 26 17:43:05 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 17:43:05 user nova-compute[73110]:     </rng>
Aug 26 17:43:05 user nova-compute[73110]:   </devices>
Aug 26 17:43:05 user nova-compute[73110]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 17:43:05 user nova-compute[73110]:     <label>libvirt-fc65c329-e780-4927-994c-defa1e9d4ea7</label>
Aug 26 17:43:05 user nova-compute[73110]:     <imagelabel>libvirt-fc65c329-e780-4927-994c-defa1e9d4ea7</imagelabel>
Aug 26 17:43:05 user nova-compute[73110]:   </seclabel>
Aug 26 17:43:05 user nova-compute[73110]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 17:43:05 user nova-compute[73110]:     <label>+64055:+108</label>
Aug 26 17:43:05 user nova-compute[73110]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 17:43:05 user nova-compute[73110]:   </seclabel>
Aug 26 17:43:05 user nova-compute[73110]: </domain>
Aug 26 17:43:05 user nova-compute[73110]:  {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 17:43:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully detached device tapb418d514-f1 from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the persistent domain config.
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] (1/8): Attempting to detach device tapb418d514-f1 with device alias net1 from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] detach device xml: <interface type="ethernet">
Aug 26 17:43:06 user nova-compute[73110]:   <mac address="fa:16:3e:ca:38:49"/>
Aug 26 17:43:06 user nova-compute[73110]:   <model type="virtio"/>
Aug 26 17:43:06 user nova-compute[73110]:   <mtu size="1442"/>
Aug 26 17:43:06 user nova-compute[73110]:   <target dev="tapb418d514-f1"/>
Aug 26 17:43:06 user nova-compute[73110]: </interface>
Aug 26 17:43:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071786.3272715, fc65c329-e780-4927-994c-defa1e9d4ea7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Start waiting for the detach event from libvirt for device tapb418d514-f1 with device alias net1 for instance fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface> {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ca:38:49"/><model type="virtio"/><mtu size="1442"/><target dev="tapb418d514-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 26 17:43:06 user nova-compute[73110]:   <name>instance-00000009</name>
Aug 26 17:43:06 user nova-compute[73110]:   <uuid>fc65c329-e780-4927-994c-defa1e9d4ea7</uuid>
Aug 26 17:43:06 user nova-compute[73110]:   <metadata>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:43:06 user nova-compute[73110]:   <nova:package version="0.0.0"/>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:name>tempest-device-tagging-server-608315562</nova:name>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:creationTime>2023-08-26 17:42:39</nova:creationTime>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:flavor name="m1.tiny">
Aug 26 17:43:06 user nova-compute[73110]:     <nova:memory>512</nova:memory>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:disk>1</nova:disk>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:swap>0</nova:swap>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:vcpus>1</nova:vcpus>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:flavor>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:owner>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:user uuid="78e86694272e4435b371b0bcfcf0ba7a">tempest-TaggedAttachmentsTest-646385816-project-member</nova:user>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:project uuid="dc2a980cd25b4845bc65840a49e61437">tempest-TaggedAttachmentsTest-646385816</nova:project>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:owner>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:ports>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:port uuid="e1957e20-b950-410f-9f65-3fb54406a445">
Aug 26 17:43:06 user nova-compute[73110]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:43:06 user nova-compute[73110]:     </nova:port>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:port uuid="b418d514-f1df-46d2-9826-40f762da2b01">
Aug 26 17:43:06 user nova-compute[73110]:       <nova:ip type="fixed" address="10.10.10.216" ipVersion="4"/>
Aug 26 17:43:06 user nova-compute[73110]:     </nova:port>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:ports>
Aug 26 17:43:06 user nova-compute[73110]: </nova:instance>
Aug 26 17:43:06 user nova-compute[73110]:   </metadata>
Aug 26 17:43:06 user nova-compute[73110]:   <memory unit='KiB'>524288</memory>
Aug 26 17:43:06 user nova-compute[73110]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 17:43:06 user nova-compute[73110]:   <vcpu placement='static'>1</vcpu>
Aug 26 17:43:06 user nova-compute[73110]:   <resource>
Aug 26 17:43:06 user nova-compute[73110]:     <partition>/machine</partition>
Aug 26 17:43:06 user nova-compute[73110]:   </resource>
Aug 26 17:43:06 user nova-compute[73110]:   <sysinfo type='smbios'>
Aug 26 17:43:06 user nova-compute[73110]:     <system>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='version'>0.0.0</entry>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='serial'>fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='uuid'>fc65c329-e780-4927-994c-defa1e9d4ea7</entry>
Aug 26 17:43:06 user nova-compute[73110]:       <entry name='family'>Virtual Machine</entry>
Aug 26 17:43:06 user nova-compute[73110]:     </system>
Aug 26 17:43:06 user nova-compute[73110]:   </sysinfo>
Aug 26 17:43:06 user nova-compute[73110]:   <os>
Aug 26 17:43:06 user nova-compute[73110]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 17:43:06 user nova-compute[73110]:     <boot dev='hd'/>
Aug 26 17:43:06 user nova-compute[73110]:     <smbios mode='sysinfo'/>
Aug 26 17:43:06 user nova-compute[73110]:   </os>
Aug 26 17:43:06 user nova-compute[73110]:   <features>
Aug 26 17:43:06 user nova-compute[73110]:     <acpi/>
Aug 26 17:43:06 user nova-compute[73110]:     <apic/>
Aug 26 17:43:06 user nova-compute[73110]:     <vmcoreinfo state='on'/>
Aug 26 17:43:06 user nova-compute[73110]:   </features>
Aug 26 17:43:06 user nova-compute[73110]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 17:43:06 user nova-compute[73110]:     <model fallback='forbid'>Nehalem</model>
Aug 26 17:43:06 user nova-compute[73110]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 17:43:06 user nova-compute[73110]:     <feature policy='require' name='vme'/>
Aug 26 17:43:06 user nova-compute[73110]:     <feature policy='require' name='x2apic'/>
Aug 26 17:43:06 user nova-compute[73110]:     <feature policy='require' name='hypervisor'/>
Aug 26 17:43:06 user nova-compute[73110]:   </cpu>
Aug 26 17:43:06 user nova-compute[73110]:   <clock offset='utc'>
Aug 26 17:43:06 user nova-compute[73110]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 17:43:06 user nova-compute[73110]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 17:43:06 user nova-compute[73110]:     <timer name='hpet' present='no'/>
Aug 26 17:43:06 user nova-compute[73110]:   </clock>
Aug 26 17:43:06 user nova-compute[73110]:   <on_poweroff>destroy</on_poweroff>
Aug 26 17:43:06 user nova-compute[73110]:   <on_reboot>restart</on_reboot>
Aug 26 17:43:06 user nova-compute[73110]:   <on_crash>destroy</on_crash>
Aug 26 17:43:06 user nova-compute[73110]:   <devices>
Aug 26 17:43:06 user nova-compute[73110]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 17:43:06 user nova-compute[73110]:     <disk type='file' device='disk'>
Aug 26 17:43:06 user nova-compute[73110]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 17:43:06 user nova-compute[73110]:       <source file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk' index='2'/>
Aug 26 17:43:06 user nova-compute[73110]:       <backingStore type='file' index='3'>
Aug 26 17:43:06 user nova-compute[73110]:         <format type='raw'/>
Aug 26 17:43:06 user nova-compute[73110]:         <source file='/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd'/>
Aug 26 17:43:06 user nova-compute[73110]:         <backingStore/>
Aug 26 17:43:06 user nova-compute[73110]:       </backingStore>
Aug 26 17:43:06 user nova-compute[73110]:       <target dev='vda' bus='virtio'/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='virtio-disk0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </disk>
Aug 26 17:43:06 user nova-compute[73110]:     <disk type='file' device='cdrom'>
Aug 26 17:43:06 user nova-compute[73110]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 17:43:06 user nova-compute[73110]:       <source file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk.config' index='1'/>
Aug 26 17:43:06 user nova-compute[73110]:       <backingStore/>
Aug 26 17:43:06 user nova-compute[73110]:       <target dev='hda' bus='ide'/>
Aug 26 17:43:06 user nova-compute[73110]:       <readonly/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='ide0-0-0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </disk>
Aug 26 17:43:06 user nova-compute[73110]:     <controller type='usb' index='0' model='none'>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='usb'/>
Aug 26 17:43:06 user nova-compute[73110]:     </controller>
Aug 26 17:43:06 user nova-compute[73110]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='pci.0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </controller>
Aug 26 17:43:06 user nova-compute[73110]:     <controller type='ide' index='0'>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='ide'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 17:43:06 user nova-compute[73110]:     </controller>
Aug 26 17:43:06 user nova-compute[73110]:     <interface type='ethernet'>
Aug 26 17:43:06 user nova-compute[73110]:       <mac address='fa:16:3e:2f:f7:82'/>
Aug 26 17:43:06 user nova-compute[73110]:       <target dev='tape1957e20-b9'/>
Aug 26 17:43:06 user nova-compute[73110]:       <model type='virtio'/>
Aug 26 17:43:06 user nova-compute[73110]:       <mtu size='1442'/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='net0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </interface>
Aug 26 17:43:06 user nova-compute[73110]:     <serial type='pty'>
Aug 26 17:43:06 user nova-compute[73110]:       <source path='/dev/pts/8'/>
Aug 26 17:43:06 user nova-compute[73110]:       <log file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log' append='off'/>
Aug 26 17:43:06 user nova-compute[73110]:       <target type='isa-serial' port='0'>
Aug 26 17:43:06 user nova-compute[73110]:         <model name='isa-serial'/>
Aug 26 17:43:06 user nova-compute[73110]:       </target>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='serial0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </serial>
Aug 26 17:43:06 user nova-compute[73110]:     <console type='pty' tty='/dev/pts/8'>
Aug 26 17:43:06 user nova-compute[73110]:       <source path='/dev/pts/8'/>
Aug 26 17:43:06 user nova-compute[73110]:       <log file='/opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/console.log' append='off'/>
Aug 26 17:43:06 user nova-compute[73110]:       <target type='serial' port='0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='serial0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </console>
Aug 26 17:43:06 user nova-compute[73110]:     <input type='mouse' bus='ps2'>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='input0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </input>
Aug 26 17:43:06 user nova-compute[73110]:     <input type='keyboard' bus='ps2'>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='input1'/>
Aug 26 17:43:06 user nova-compute[73110]:     </input>
Aug 26 17:43:06 user nova-compute[73110]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 26 17:43:06 user nova-compute[73110]:       <listen type='address' address='0.0.0.0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </graphics>
Aug 26 17:43:06 user nova-compute[73110]:     <audio id='1' type='none'/>
Aug 26 17:43:06 user nova-compute[73110]:     <video>
Aug 26 17:43:06 user nova-compute[73110]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='video0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </video>
Aug 26 17:43:06 user nova-compute[73110]:     <memballoon model='virtio'>
Aug 26 17:43:06 user nova-compute[73110]:       <stats period='10'/>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='balloon0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </memballoon>
Aug 26 17:43:06 user nova-compute[73110]:     <rng model='virtio'>
Aug 26 17:43:06 user nova-compute[73110]:       <backend model='random'>/dev/urandom</backend>
Aug 26 17:43:06 user nova-compute[73110]:       <alias name='rng0'/>
Aug 26 17:43:06 user nova-compute[73110]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 17:43:06 user nova-compute[73110]:     </rng>
Aug 26 17:43:06 user nova-compute[73110]:   </devices>
Aug 26 17:43:06 user nova-compute[73110]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 17:43:06 user nova-compute[73110]:     <label>libvirt-fc65c329-e780-4927-994c-defa1e9d4ea7</label>
Aug 26 17:43:06 user nova-compute[73110]:     <imagelabel>libvirt-fc65c329-e780-4927-994c-defa1e9d4ea7</imagelabel>
Aug 26 17:43:06 user nova-compute[73110]:   </seclabel>
Aug 26 17:43:06 user nova-compute[73110]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 17:43:06 user nova-compute[73110]:     <label>+64055:+108</label>
Aug 26 17:43:06 user nova-compute[73110]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 17:43:06 user nova-compute[73110]:   </seclabel>
Aug 26 17:43:06 user nova-compute[73110]: </domain>
Aug 26 17:43:06 user nova-compute[73110]:  {{(pid=73110) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 17:43:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully detached device tapb418d514-f1 from instance fc65c329-e780-4927-994c-defa1e9d4ea7 from the live domain config.
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "b418d514-f1df-46d2-9826-40f762da2b01", "address": "fa:16:3e:ca:38:49", "network": {"id": "5834e25e-1823-481a-a777-c42bb8f5c71b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-788807149", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb418d514-f1", "ovs_interfaceid": "b418d514-f1df-46d2-9826-40f762da2b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG os_vif [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb418d514-f1, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:06 user nova-compute[73110]: INFO os_vif [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:38:49,bridge_name='br-int',has_traffic_filtering=True,id=b418d514-f1df-46d2-9826-40f762da2b01,network=Network(5834e25e-1823-481a-a777-c42bb8f5c71b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb418d514-f1')
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:43:06 user nova-compute[73110]:   <nova:package version="0.0.0"/>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:name>tempest-device-tagging-server-608315562</nova:name>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:creationTime>2023-08-26 17:43:06</nova:creationTime>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:flavor name="m1.tiny">
Aug 26 17:43:06 user nova-compute[73110]:     <nova:memory>512</nova:memory>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:disk>1</nova:disk>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:swap>0</nova:swap>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:vcpus>1</nova:vcpus>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:flavor>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:owner>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:user uuid="78e86694272e4435b371b0bcfcf0ba7a">tempest-TaggedAttachmentsTest-646385816-project-member</nova:user>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:project uuid="dc2a980cd25b4845bc65840a49e61437">tempest-TaggedAttachmentsTest-646385816</nova:project>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:owner>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:43:06 user nova-compute[73110]:   <nova:ports>
Aug 26 17:43:06 user nova-compute[73110]:     <nova:port uuid="e1957e20-b950-410f-9f65-3fb54406a445">
Aug 26 17:43:06 user nova-compute[73110]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:43:06 user nova-compute[73110]:     </nova:port>
Aug 26 17:43:06 user nova-compute[73110]:   </nova:ports>
Aug 26 17:43:06 user nova-compute[73110]: </nova:instance>
Aug 26 17:43:06 user nova-compute[73110]:  {{(pid=73110) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-unplugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-unplugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:06 user nova-compute[73110]: WARNING nova.compute.manager [req-e9e3b92c-d1a8-435a-b66b-266dfe004a52 req-1b3558a5-f932-49ca-9578-1cdd04c80e36 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-unplugged-b418d514-f1df-46d2-9826-40f762da2b01 for instance with vm_state active and task_state None.
Aug 26 17:43:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquired lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:07 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:43:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:08 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a8931-71eb-4dd4-abaa-17ca0832b082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc0d815-9403-4c26-8b15-26e28c8328d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544196b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'): ({'sdg'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Removing single pathed devices sdg {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b3146-4920-4b2f-b107-5ca537a7ea60]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0830df-8d95-41b6-bb04-7f2d79ac6ae3]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Flushing IO for device /dev/sdg {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4bbf9d-b480-4221-a0dd-34f08816c9d3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72583986-2b75-4df4-82b5-01b36b5e5a10]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] SCSI volumes sdg have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed2cc0-d770-4144-9678-9d62d8f05b29]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b73d0-1069-40fa-a152-37d6b36c41b7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]
Aug 26 17:43:08 user nova-compute[73110]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[73519569-c9b9-423d-9be0-18998ad84186]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== disconnect_volume: return (320ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0', 'serial'} {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: removing Cinder connection for volume 3c583d07-6bf8-4183-8707-20f3bea03261 {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 17:43:08 user nova-compute[73110]: INFO nova.network.neutron [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Port b418d514-f1df-46d2-9826-40f762da2b01 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [{"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Releasing lock "refresh_cache-fc65c329-e780-4927-994c-defa1e9d4ea7" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f91d9cb4-9fb7-41d7-b638-4996fe2e32c4 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "interface-fc65c329-e780-4927-994c-defa1e9d4ea7-b418d514-f1df-46d2-9826-40f762da2b01" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.731s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:08 user nova-compute[73110]: WARNING nova.compute.manager [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-b418d514-f1df-46d2-9826-40f762da2b01 for instance with vm_state active and task_state None.
Aug 26 17:43:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-462268cf-116c-4056-95ef-7722cfe693c8 req-0d4d6b2f-f6d7-4f8c-9e25-68c750d6ad99 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-deleted-b418d514-f1df-46d2-9826-40f762da2b01 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: Updating volume 3c583d07-6bf8-4183-8707-20f3bea03261 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "mYhHGtEU", "auth_password": "yvSaeLzb5fDGtn", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "8195e257-f149-489b-ab0d-47723afb7cc0"}, "status": "reserved", "instance": "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c", "attached_at": "", "detached_at": "", "volume_id": "8195e257-f149-489b-ab0d-47723afb7cc0", "serial": "8195e257-f149-489b-ab0d-47723afb7cc0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0', 'no_device': None, 'attachment_id': 'cdcda4f9-f87c-425c-8810-351c50f7d486'} {{(pid=73110) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 17:43:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6b9aa2-d64e-4fa6-a146-8fc700ecdff3 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.476s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.utils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d478b-d03b-4b38-b3bd-2067d09f3ba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132a578-c7ee-4ae1-a57c-4533c9a25c01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a3ec5-e2ba-4975-b96b-2af3ab10fd9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[662bd832-6755-4dd2-a306-734cbf3bffe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:10 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:43:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[015197f1-683a-4653-9497-0b4ff91d3351]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:43:10 user nova-compute[73110]: DEBUG os_brick.utils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:10 user nova-compute[73110]: INFO nova.compute.manager [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Swapping volume 8195e257-f149-489b-ab0d-47723afb7cc0 for 3c583d07-6bf8-4183-8707-20f3bea03261
Aug 26 17:43:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:12 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071777.869575, 9c5fcd4b-2df1-485e-a979-30fda49229b3 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:43:12 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] VM Stopped (Lifecycle Event)
Aug 26 17:43:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-393d6076-27da-489f-b8aa-9e27f4967cd4 None None] [instance: 9c5fcd4b-2df1-485e-a979-30fda49229b3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '3c583d07-6bf8-4183-8707-20f3bea03261', 'serial': '3c583d07-6bf8-4183-8707-20f3bea03261'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0'}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0', 'serial'} {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:21 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:43:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc8eb48-4b7d-40e0-8f7a-6b9b28cb2820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:43:22 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd9678-aa65-4431-806d-2123f39dc409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261] added
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19753607-36a9-4cc3-a175-b1aba7f3062f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1a108-99d6-4beb-ba90-76094ca5c8b0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPUeuqt {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaPUeuqt" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a0242-78ea-4c8e-8db1-8c797547fdcc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZaPUeuqt'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53ed35-9bc1-4b6d-a4fa-0a480000deae]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39653e-e10d-4d01-a2bd-be4e475c41f5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b8a94-4b5a-42bc-a967-324fed045dda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]
Aug 26 17:43:22 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2bbc40-ec38-4886-aca9-e971f718c3d2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c326e-4da1-4a91-821c-4eb26011e079]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0043b1-f4b0-416e-993b-11daa2db0daf]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:43:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:43:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26530356462613965', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530356462613965', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:43:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lazy-loading 'flavor' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 497025024 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 718274560 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYhHGtEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '8195e257-f149-489b-ab0d-47723afb7cc0'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:27 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32c6ba-3eef-415d-ba2b-ad393ce75bc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5433d3f-4920-4bb4-8c01-4874f06db734]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5447045e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0'): ({'sdh'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Removing single pathed devices sdh {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:43:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205d605-7096-4a7d-8454-d0d27ac134e8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34c06a-021b-4f70-ac86-5b4c9e952b2a]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Flushing IO for device /dev/sdh {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7ba5f-919c-4f57-94f5-d64c3c522ebe]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fde8dc2-5359-4f8a-9597-87b70fb389ce]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113c254-1f71-4451-a7e4-d73cd42d901e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dc3547-d333-4bf1-b9f5-b6008d694146]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260]
Aug 26 17:43:28 user nova-compute[73110]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8195e257-f149-489b-ab0d-47723afb7cc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a024f-6d79-4a69-bae1-1987df0ad0a6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] <== disconnect_volume: return (294ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c', 'attached_at': '', 'detached_at': '', 'volume_id': '3c583d07-6bf8-4183-8707-20f3bea03261', 'serial'} {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 17:43:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: removing Cinder connection for volume 8195e257-f149-489b-ab0d-47723afb7cc0 {{(pid=73110) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 17:43:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] swap_volume: Updating volume 8195e257-f149-489b-ab0d-47723afb7cc0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ZaPUeuqt", "auth_password": "KI4xnesNa1AYgj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "3c583d07-6bf8-4183-8707-20f3bea03261"}, "status": "reserved", "instance": "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c", "attached_at": "", "detached_at": "", "volume_id": "3c583d07-6bf8-4183-8707-20f3bea03261", "serial": "3c583d07-6bf8-4183-8707-20f3bea03261"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3c583d07-6bf8-4183-8707-20f3bea03261', 'no_device': None, 'attachment_id': '97857047-fd75-409b-82f9-83353d25dbfb'} {{(pid=73110) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 17:43:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-16842052-7ba2-4699-8a01-18972f5ada14 tempest-TestVolumeSwap-1749772186 tempest-TestVolumeSwap-1749772186-project-admin] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.807s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:30 user nova-compute[73110]: INFO nova.compute.manager [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Detaching volume 3c583d07-6bf8-4183-8707-20f3bea03261
Aug 26 17:43:30 user nova-compute[73110]: INFO nova.virt.block_device [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Attempting to driver detach volume 3c583d07-6bf8-4183-8707-20f3bea03261 from mountpoint /dev/vdb
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Attempting to detach device vdb from instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:43:30 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:43:30 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:43:30 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:43:30 user nova-compute[73110]:   <serial>3c583d07-6bf8-4183-8707-20f3bea03261</serial>
Aug 26 17:43:30 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:43:30 user nova-compute[73110]: </disk>
Aug 26 17:43:30 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Successfully detached device vdb from instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c from the persistent domain config.
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:43:30 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:43:30 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:43:30 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:43:30 user nova-compute[73110]:   <serial>3c583d07-6bf8-4183-8707-20f3bea03261</serial>
Aug 26 17:43:30 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:43:30 user nova-compute[73110]: </disk>
Aug 26 17:43:30 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071810.536442, 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:43:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Successfully detached device vdb from instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c from the live domain config.
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaPUeuqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '3c583d07-6bf8-4183-8707-20f3bea03261'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:30 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6753813c-d56e-4b0e-bb46-afd4c06cc3d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13070d8-7b95-4981-9021-5ce9e9e21d67]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:43:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5445712d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce47899-f9ff-4632-aa0c-284b15fef99b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca2b3e0-b678-4590-9319-8ec045724c97]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f271784-03e3-4831-8c09-b83fe3200133]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[782aa169-a81a-4e35-b93d-6d00e9facf23]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[83284e5b-2767-4edb-bdb3-cacb4ad5bae9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0881b3a-8039-44aa-ace3-ca1f23164176]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260]
Aug 26 17:43:30 user nova-compute[73110]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261, portal: 172.16.0.220,3260] successful.
Aug 26 17:43:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c583d07-6bf8-4183-8707-20f3bea03261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[45658f6c-7092-403b-9994-334a7243f836]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] <== disconnect_volume: return (287ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:43:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lazy-loading 'flavor' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de8d164a-20ea-49c1-a71a-202cb7d8043e tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:43:39 user nova-compute[73110]: INFO nova.compute.claims [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Claim successful on node user
Aug 26 17:43:39 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:43:39 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:43:40 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.policy [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07467ef74ea34f21949b8a00da319315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88799fc21bb642ecb30f13d1b9ba20d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:43:40 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Creating image(s)
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "/opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "/opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "/opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk 1073741824" returned: 0 in 0.048s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Successfully created port: 9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:43:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Cannot resize image /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Successfully updated port: 9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquired lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-changed-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Refreshing instance network info cache due to event network-changed-9cd01dda-0f42-449b-a0d7-d8bba46dfad7. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] Acquiring lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Updating instance_info_cache with network_info: [{"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Releasing lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Instance network_info: |[{"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] Acquired lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.network.neutron [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Refreshing network info cache for port 9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Start _get_guest_xml network_info=[{"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:43:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:43:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:43:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980581169',display_name='tempest-VolumesAdminNegativeTest-server-1980581169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980581169',id=12,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-0fgjrwpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:43:40Z,user_data=None,user_id='07467ef74ea34f21949b8a00da319315',uuid=68d61f94-0fcb-4a6f-85e0-d441ab789aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:43:42 user nova-compute[73110]:   <uuid>68d61f94-0fcb-4a6f-85e0-d441ab789aa1</uuid>
Aug 26 17:43:42 user nova-compute[73110]:   <name>instance-0000000c</name>
Aug 26 17:43:42 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:43:42 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:43:42 user nova-compute[73110]:   <metadata>
Aug 26 17:43:42 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:43:42 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1980581169</nova:name>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:43:41</nova:creationTime>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:43:42 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:43:42 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:owner>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:user uuid="07467ef74ea34f21949b8a00da319315">tempest-VolumesAdminNegativeTest-154505172-project-member</nova:user>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:project uuid="88799fc21bb642ecb30f13d1b9ba20d7">tempest-VolumesAdminNegativeTest-154505172</nova:project>
Aug 26 17:43:42 user nova-compute[73110]:       </nova:owner>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:43:42 user nova-compute[73110]:       <nova:ports>
Aug 26 17:43:42 user nova-compute[73110]:         <nova:port uuid="9cd01dda-0f42-449b-a0d7-d8bba46dfad7">
Aug 26 17:43:42 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 17:43:42 user nova-compute[73110]:         </nova:port>
Aug 26 17:43:42 user nova-compute[73110]:       </nova:ports>
Aug 26 17:43:42 user nova-compute[73110]:     </nova:instance>
Aug 26 17:43:42 user nova-compute[73110]:   </metadata>
Aug 26 17:43:42 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:43:42 user nova-compute[73110]:     <system>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="serial">68d61f94-0fcb-4a6f-85e0-d441ab789aa1</entry>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="uuid">68d61f94-0fcb-4a6f-85e0-d441ab789aa1</entry>
Aug 26 17:43:42 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:43:42 user nova-compute[73110]:     </system>
Aug 26 17:43:42 user nova-compute[73110]:   </sysinfo>
Aug 26 17:43:42 user nova-compute[73110]:   <os>
Aug 26 17:43:42 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:43:42 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:43:42 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:43:42 user nova-compute[73110]:   </os>
Aug 26 17:43:42 user nova-compute[73110]:   <features>
Aug 26 17:43:42 user nova-compute[73110]:     <acpi/>
Aug 26 17:43:42 user nova-compute[73110]:     <apic/>
Aug 26 17:43:42 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:43:42 user nova-compute[73110]:   </features>
Aug 26 17:43:42 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:43:42 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:43:42 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:43:42 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:43:42 user nova-compute[73110]:   </clock>
Aug 26 17:43:42 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:43:42 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:43:42 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:43:42 user nova-compute[73110]:   </cpu>
Aug 26 17:43:42 user nova-compute[73110]:   <devices>
Aug 26 17:43:42 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:43:42 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:43:42 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk"/>
Aug 26 17:43:42 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:43:42 user nova-compute[73110]:     </disk>
Aug 26 17:43:42 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:43:42 user nova-compute[73110]:       <mac address="fa:16:3e:b3:19:43"/>
Aug 26 17:43:42 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:43:42 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:43:42 user nova-compute[73110]:       <target dev="tap9cd01dda-0f"/>
Aug 26 17:43:42 user nova-compute[73110]:     </interface>
Aug 26 17:43:42 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:43:42 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/console.log" append="off"/>
Aug 26 17:43:42 user nova-compute[73110]:     </serial>
Aug 26 17:43:42 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:43:42 user nova-compute[73110]:     <video>
Aug 26 17:43:42 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:43:42 user nova-compute[73110]:     </video>
Aug 26 17:43:42 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:43:42 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:43:42 user nova-compute[73110]:     </rng>
Aug 26 17:43:42 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:43:42 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:43:42 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:43:42 user nova-compute[73110]:     </memballoon>
Aug 26 17:43:42 user nova-compute[73110]:   </devices>
Aug 26 17:43:42 user nova-compute[73110]: </domain>
Aug 26 17:43:42 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980581169',display_name='tempest-VolumesAdminNegativeTest-server-1980581169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980581169',id=12,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-0fgjrwpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:43:40Z,user_data=None,user_id='07467ef74ea34f21949b8a00da319315',uuid=68d61f94-0fcb-4a6f-85e0-d441ab789aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG os_vif [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cd01dda-0f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cd01dda-0f, col_values=(('external_ids', {'iface-id': '9cd01dda-0f42-449b-a0d7-d8bba46dfad7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:19:43', 'vm-uuid': '68d61f94-0fcb-4a6f-85e0-d441ab789aa1'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:42 user nova-compute[73110]: INFO os_vif [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f')
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] No VIF found with MAC fa:16:3e:b3:19:43, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Updated VIF entry in instance network info cache for port 9cd01dda-0f42-449b-a0d7-d8bba46dfad7. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Updating instance_info_cache with network_info: [{"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-55d44372-6553-41a0-b581-f5e26e0ce289 req-77d97fb9-ac03-4713-b3c5-335a79176bc3 service nova] Releasing lock "refresh_cache-68d61f94-0fcb-4a6f-85e0-d441ab789aa1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] No waiting events found dispatching network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:43 user nova-compute[73110]: WARNING nova.compute.manager [req-db759f1a-135d-4f2a-8705-4aaa88e32659 req-6f8252a1-0a6b-4177-bcbc-ac52fce174e6 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received unexpected event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 for instance with vm_state building and task_state spawning.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071825.5365422, 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] VM Resumed (Lifecycle Event)
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Instance spawned successfully.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071825.5406291, 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] VM Started (Lifecycle Event)
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] No waiting events found dispatching network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:45 user nova-compute[73110]: WARNING nova.compute.manager [req-ba4502b8-d572-4f56-8465-524564d1dbfe req-b0f81412-e5e9-4175-a7cc-41ad5f0ea2e7 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received unexpected event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 for instance with vm_state building and task_state spawning.
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:45 user nova-compute[73110]: INFO nova.compute.manager [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Took 6.23 seconds to build instance.
Aug 26 17:43:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2b6b71c0-5974-4dae-b427-2b6080609907 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.327s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:47 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:43:47 user nova-compute[73110]: INFO nova.compute.claims [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Claim successful on node user
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:43:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.policy [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c351654543af4a9a86d72d041fcaacb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8688c8465f324c4a9196980792b35718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:43:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Creating image(s)
Aug 26 17:43:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.284s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk 1073741824" returned: 0 in 0.064s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Cannot resize image /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Ensure instance console log exists: /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Successfully created port: a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Successfully updated port: a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-changed-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Refreshing instance network info cache due to event network-changed-a045650c-7390-47e9-9a99-586c63fcd273. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] Acquiring lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:50 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.neutron [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating instance_info_cache with network_info: [{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance network_info: |[{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] Acquired lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.neutron [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Refreshing network info cache for port a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start _get_guest_xml network_info=[{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:43:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:43:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-tempest.common.compute-instance-1752912019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'pci_devices' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:43:51 user nova-compute[73110]:   <uuid>8662b876-8ed7-4b01-b28a-ce551b8d0097</uuid>
Aug 26 17:43:51 user nova-compute[73110]:   <name>instance-0000000d</name>
Aug 26 17:43:51 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:43:51 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:43:51 user nova-compute[73110]:   <metadata>
Aug 26 17:43:51 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:43:51 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:name>tempest-tempest.common.compute-instance-1752912019</nova:name>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:43:51</nova:creationTime>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:43:51 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:43:51 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:owner>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:user uuid="c351654543af4a9a86d72d041fcaacb4">tempest-ServerActionsTestOtherA-1020251450-project-member</nova:user>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:project uuid="8688c8465f324c4a9196980792b35718">tempest-ServerActionsTestOtherA-1020251450</nova:project>
Aug 26 17:43:51 user nova-compute[73110]:       </nova:owner>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:43:51 user nova-compute[73110]:       <nova:ports>
Aug 26 17:43:51 user nova-compute[73110]:         <nova:port uuid="a045650c-7390-47e9-9a99-586c63fcd273">
Aug 26 17:43:51 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:43:51 user nova-compute[73110]:         </nova:port>
Aug 26 17:43:51 user nova-compute[73110]:       </nova:ports>
Aug 26 17:43:51 user nova-compute[73110]:     </nova:instance>
Aug 26 17:43:51 user nova-compute[73110]:   </metadata>
Aug 26 17:43:51 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:43:51 user nova-compute[73110]:     <system>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="serial">8662b876-8ed7-4b01-b28a-ce551b8d0097</entry>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="uuid">8662b876-8ed7-4b01-b28a-ce551b8d0097</entry>
Aug 26 17:43:51 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:43:51 user nova-compute[73110]:     </system>
Aug 26 17:43:51 user nova-compute[73110]:   </sysinfo>
Aug 26 17:43:51 user nova-compute[73110]:   <os>
Aug 26 17:43:51 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:43:51 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:43:51 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:43:51 user nova-compute[73110]:   </os>
Aug 26 17:43:51 user nova-compute[73110]:   <features>
Aug 26 17:43:51 user nova-compute[73110]:     <acpi/>
Aug 26 17:43:51 user nova-compute[73110]:     <apic/>
Aug 26 17:43:51 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:43:51 user nova-compute[73110]:   </features>
Aug 26 17:43:51 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:43:51 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:43:51 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:43:51 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:43:51 user nova-compute[73110]:   </clock>
Aug 26 17:43:51 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:43:51 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:43:51 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:43:51 user nova-compute[73110]:   </cpu>
Aug 26 17:43:51 user nova-compute[73110]:   <devices>
Aug 26 17:43:51 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:43:51 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:43:51 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk"/>
Aug 26 17:43:51 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:43:51 user nova-compute[73110]:     </disk>
Aug 26 17:43:51 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:43:51 user nova-compute[73110]:       <mac address="fa:16:3e:98:9c:ee"/>
Aug 26 17:43:51 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:43:51 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:43:51 user nova-compute[73110]:       <target dev="tapa045650c-73"/>
Aug 26 17:43:51 user nova-compute[73110]:     </interface>
Aug 26 17:43:51 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:43:51 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/console.log" append="off"/>
Aug 26 17:43:51 user nova-compute[73110]:     </serial>
Aug 26 17:43:51 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:43:51 user nova-compute[73110]:     <video>
Aug 26 17:43:51 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:43:51 user nova-compute[73110]:     </video>
Aug 26 17:43:51 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:43:51 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:43:51 user nova-compute[73110]:     </rng>
Aug 26 17:43:51 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:43:51 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:43:51 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:43:51 user nova-compute[73110]:     </memballoon>
Aug 26 17:43:51 user nova-compute[73110]:   </devices>
Aug 26 17:43:51 user nova-compute[73110]: </domain>
Aug 26 17:43:51 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-tempest.common.compute-instance-1752912019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG os_vif [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa045650c-73, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa045650c-73, col_values=(('external_ids', {'iface-id': 'a045650c-7390-47e9-9a99-586c63fcd273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9c:ee', 'vm-uuid': '8662b876-8ed7-4b01-b28a-ce551b8d0097'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:51 user nova-compute[73110]: INFO os_vif [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73')
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:98:9c:ee, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'flavor' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:51 user nova-compute[73110]: INFO nova.compute.manager [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Attaching volume 61dd01de-405d-4b62-bd9f-096e972d7e16 to /dev/vdb
Aug 26 17:43:51 user nova-compute[73110]: DEBUG os_brick.utils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba0df10-0133-4ea7-b385-101e4152628e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d5e9b7-eb70-4f6e-83de-11b73c74cae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd804cc-0873-4938-b36d-c87522e70be8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88c110e-a032-434b-8255-e516b845b350]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:51 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:43:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0019c44-6021-48db-bc52-154f79b482a4]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG os_brick.utils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating existing volume attachment record: ea99dedd-fafa-4fb8-a916-7d7d40b54d43 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updated VIF entry in instance network info cache for port a045650c-7390-47e9-9a99-586c63fcd273. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating instance_info_cache with network_info: [{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e4c0b17-1fd5-41f9-83e9-64576fbe0b8a req-3987ab43-9eab-4aa7-bfca-255b2922d785 service nova] Releasing lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG nova.objects.instance [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'flavor' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:52 user nova-compute[73110]: INFO nova.compute.manager [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attaching volume 16ce92dd-4c14-4812-96fa-f01590e810a9 to /dev/vdb
Aug 26 17:43:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.utils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:53 user nova-compute[73110]: WARNING nova.compute.manager [req-450ac00b-292b-4945-b559-e4ac86c9a64f req-c556e3fc-772f-4ad9-ab85-2a5087a3f9c3 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state building and task_state spawning.
Aug 26 17:43:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf3d86-af25-430b-8ec8-302f2646aac9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0011de65-c9de-493e-b484-71a3a0635af1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f68d951-8af1-4b40-9ea9-d96f07ccaf08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b573afd3-78fe-4f6f-b383-604df412e18d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:43:53 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171caa5-393c-4baa-88f1-ad5a45310fa2]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG os_brick.utils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating existing volume attachment record: 9a12ecd6-d788-41e0-94ae-2197069613ab {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:43:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071835.0515738, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Resumed (Lifecycle Event)
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance spawned successfully.
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071835.0608926, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Started (Lifecycle Event)
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:55 user nova-compute[73110]: WARNING nova.compute.manager [req-6975e054-4247-482e-b5f8-82015964e142 req-539fb1c1-0fa7-473d-81da-da01644d924a service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state building and task_state spawning.
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Took 6.51 seconds to spawn the instance on the hypervisor.
Aug 26 17:43:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:55 user nova-compute[73110]: INFO nova.compute.manager [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Took 7.55 seconds to build instance.
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68bd03f4-eec5-4d98-81b6-7a33117adc1a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.673s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:56 user nova-compute[73110]: INFO nova.compute.manager [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Terminating instance
Aug 26 17:43:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-unplugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] No waiting events found dispatching network-vif-unplugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-5956ed3e-b27b-4710-9294-aee6dcd79e8b req-edecbdf5-2877-49a5-a71c-17ead7710fec service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-unplugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:57 user nova-compute[73110]: INFO nova.compute.manager [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Terminating instance
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:43:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Instance destroyed successfully.
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.objects.instance [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lazy-loading 'resources' on Instance uuid 66e24787-eb7a-48f9-85bc-b99392dc21a8 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-531882543',display_name='tempest-VolumesAssistedSnapshotsTest-server-531882543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-531882543',id=10,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBOyrZ9KglT6DfMKSwx7qZ0oBuBLoC6Ts/jg2tAgLPCOEHa6j4Fa3iYLCaxyvsc0UJW/erW6SXETmZDrsp5mHQg5mjWc0P6PX57ufz8WBkW3NHM/bVhmlYGWTNJk/3O6w==',key_name='tempest-keypair-67120618',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd4c4da9abd4c7c896e84d64b24f02c',ramdisk_id='',reservation_id='r-j08at3p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2091022039',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2091022039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13439fcd22a44eda929d6b9f57431c0',uuid=66e24787-eb7a-48f9-85bc-b99392dc21a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converting VIF {"id": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "address": "fa:16:3e:f9:0b:7f", "network": {"id": "f614af1b-b4b4-4d92-9c53-b9ad0c71fc75", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-872549529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd4c4da9abd4c7c896e84d64b24f02c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bc7b8b-18", "ovs_interfaceid": "90bc7b8b-188a-4c3d-83ca-cb93169628bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG os_vif [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90bc7b8b-18, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:57 user nova-compute[73110]: INFO os_vif [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=90bc7b8b-188a-4c3d-83ca-cb93169628bc,network=Network(f614af1b-b4b4-4d92-9c53-b9ad0c71fc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bc7b8b-18')
Aug 26 17:43:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Deleting instance files /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8_del
Aug 26 17:43:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Deletion of /opt/stack/data/nova/instances/66e24787-eb7a-48f9-85bc-b99392dc21a8_del complete
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:57 user nova-compute[73110]: INFO nova.compute.manager [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-unplugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-unplugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-3aacfceb-e6b5-4c7b-be34-8298c090768c req-76d7496d-c94c-448a-b912-d6b6fb19f355 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-unplugged-e1957e20-b950-410f-9f65-3fb54406a445 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Instance destroyed successfully.
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lazy-loading 'resources' on Instance uuid fc65c329-e780-4927-994c-defa1e9d4ea7 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-608315562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-608315562',id=9,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfzIH14E4YRMCKXoosIKSZ1KDtR6mwFaYhd1iT4CokicqJcYSpl/YAi/UrvFOA3x29Yr51WTAMqj7YcisG1bIHbMkwuGOFYfhE1kJ1eP9XQvt/pTAUyOxV41+jnAZRZ4A==',key_name='tempest-keypair-1130673868',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2a980cd25b4845bc65840a49e61437',ramdisk_id='',reservation_id='r-6wfi0kg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-646385816',owner_user_name='tempest-TaggedAttachmentsTest-646385816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e86694272e4435b371b0bcfcf0ba7a',uuid=fc65c329-e780-4927-994c-defa1e9d4ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converting VIF {"id": "e1957e20-b950-410f-9f65-3fb54406a445", "address": "fa:16:3e:2f:f7:82", "network": {"id": "f539b5db-97cf-4291-82df-aba601a13d58", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1412778615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2a980cd25b4845bc65840a49e61437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1957e20-b9", "ovs_interfaceid": "e1957e20-b950-410f-9f65-3fb54406a445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG os_vif [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1957e20-b9, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:58 user nova-compute[73110]: INFO os_vif [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=e1957e20-b950-410f-9f65-3fb54406a445,network=Network(f539b5db-97cf-4291-82df-aba601a13d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1957e20-b9')
Aug 26 17:43:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Deleting instance files /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7_del
Aug 26 17:43:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Deletion of /opt/stack/data/nova/instances/fc65c329-e780-4927-994c-defa1e9d4ea7_del complete
Aug 26 17:43:58 user nova-compute[73110]: INFO nova.compute.manager [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] Acquiring lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] No waiting events found dispatching network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:43:59 user nova-compute[73110]: WARNING nova.compute.manager [req-093db70f-f2f3-4fa0-aaa6-6bb51f1164c6 req-7e9a9b31-6d50-4b70-b6a8-9775a5eb0a03 service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received unexpected event network-vif-plugged-90bc7b8b-188a-4c3d-83ca-cb93169628bc for instance with vm_state active and task_state deleting.
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:43:59 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Took 1.73 seconds to deallocate network for instance.
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:43:59 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] Acquiring lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] No waiting events found dispatching network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:00 user nova-compute[73110]: WARNING nova.compute.manager [req-964bcf1e-3284-4ba4-9077-72ccae54c48d req-2fd98563-2427-4dd2-837c-37d3291d09b0 service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received unexpected event network-vif-plugged-e1957e20-b950-410f-9f65-3fb54406a445 for instance with vm_state active and task_state deleting.
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.666s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:00 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Deleted allocations for instance 66e24787-eb7a-48f9-85bc-b99392dc21a8
Aug 26 17:44:00 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:00 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Took 1.58 seconds to deallocate network for instance.
Aug 26 17:44:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-02dce87a-493d-4a48-accb-d41f5460c08c tempest-VolumesAssistedSnapshotsTest-2091022039 tempest-VolumesAssistedSnapshotsTest-2091022039-project-member] Lock "66e24787-eb7a-48f9-85bc-b99392dc21a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.465s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=25.573551177978516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:44:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-fcc1ac2f-e9c4-4c5f-80be-4945c9c53197 req-291c8a44-a9bc-41f1-ae76-cb703834f9fd service nova] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Received event network-vif-deleted-90bc7b8b-188a-4c3d-83ca-cb93169628bc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-fcc1ac2f-e9c4-4c5f-80be-4945c9c53197 req-291c8a44-a9bc-41f1-ae76-cb703834f9fd service nova] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Received event network-vif-deleted-e1957e20-b950-410f-9f65-3fb54406a445 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.460s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:01 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Deleted allocations for instance fc65c329-e780-4927-994c-defa1e9d4ea7
Aug 26 17:44:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5e726467-21cf-42c1-b251-10710bd50f74 tempest-TaggedAttachmentsTest-646385816 tempest-TaggedAttachmentsTest-646385816-project-member] Lock "fc65c329-e780-4927-994c-defa1e9d4ea7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.366s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0611d638-abf0-45f2-8708-1cc2790ffe99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:44:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:12 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071837.3076665, 66e24787-eb7a-48f9-85bc-b99392dc21a8 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:12 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] VM Stopped (Lifecycle Event)
Aug 26 17:44:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cecfe8e5-0e9f-4bae-b056-29909992630c None None] [instance: 66e24787-eb7a-48f9-85bc-b99392dc21a8] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:13 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071838.1411805, fc65c329-e780-4927-994c-defa1e9d4ea7 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:13 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] VM Stopped (Lifecycle Event)
Aug 26 17:44:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-76d3c717-8622-4cf9-b509-b6732a5f67d8 None None] [instance: fc65c329-e780-4927-994c-defa1e9d4ea7] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'info_cache' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance destroyed successfully.
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'resources' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf549c20-9f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:15 user nova-compute[73110]: INFO os_vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b6745-450c-47c8-8a61-07e32d7a1d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef80dc-b2e0-4560-b1b1-7b5b5cc9e024]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'): ({'sdf'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Removing single pathed devices sdf {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[60220223-688f-4898-96f4-a5f20a577b85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc5388-9946-4dd2-9ed5-c7cd524c29f5]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flushing IO for device /dev/sdf {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc68a9-3c74-4344-a4b9-266b8bc9a414]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-changed-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing instance network info cache due to event network-changed-18221bdb-6702-49fd-8e9c-43f1b9a123b5. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] Acquiring lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] Acquired lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Refreshing network info cache for port 18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae33d1-526a-4341-ae13-c36be924e196]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5affa53-8a9d-4798-af2e-2f562e53d845]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b3cf8-d27a-439c-83ce-c44ad809f24d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]
Aug 26 17:44:15 user nova-compute[73110]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d199c5-47ad-474e-b4ce-9870449675cd]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== disconnect_volume: return (343ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start _get_guest_xml network_info=[{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9c4746a4-c4f5-4657-89ce-daf1e450de2b', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7a5294e5-ba09-49bd-b78a-33ebc306d925', 'attached_at': '', 'detached_at': '', 'volume_id': '0de89c12-2d48-4021-9fac-fa17cf1aacc1', 'serial': '0de89c12-2d48-4021-9fac-fa17cf1aacc1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'numa_topology' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:15 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e40962-adb4-49c0-bd3a-331759f12645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:44:15 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8ec21-59d8-4bec-8dd0-b8edb2ec0cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1] added
Aug 26 17:44:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf70ca-4e00-49d0-b2fb-90a3b103a238]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc78798f-43b6-4592-bdad-d681c2c19866]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdjevIQ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMdjevIQ" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3f0aa-d4a0-41d9-b7dc-4e5875519ee5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMdjevIQ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2143a7-1d44-4906-aa5c-274680007cac]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f3a664-38f6-4220-9274-476df5de7ecf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6b8045-09e7-40ad-890d-559c02689a19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]
Aug 26 17:44:16 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7c0d42-e05a-4b42-b32b-72d0affd05bf]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaff010-6e45-4b7f-8db2-10f49873178d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:16 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6b7b76-cbd3-4044-8c54-3603504acc4e]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG nova.network.neutron [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updated VIF entry in instance network info cache for port 18221bdb-6702-49fd-8e9c-43f1b9a123b5. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG nova.network.neutron [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f59f89b5-4c4e-4074-97ed-7ed6ddc1bdde req-017a8fd0-6468-4bc2-a3a4-1757ebb91eb3 service nova] Releasing lock "refresh_cache-0611d638-abf0-45f2-8708-1cc2790ffe99" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26535306535626633', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535306535626633', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:44:17 user nova-compute[73110]:   <uuid>7a5294e5-ba09-49bd-b78a-33ebc306d925</uuid>
Aug 26 17:44:17 user nova-compute[73110]:   <name>instance-00000005</name>
Aug 26 17:44:17 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:44:17 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:44:17 user nova-compute[73110]:   <metadata>
Aug 26 17:44:17 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:44:17 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeTestJSON-server-934297327</nova:name>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:44:15</nova:creationTime>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:44:17 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:44:17 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:owner>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:user uuid="65b8f68535c94d32b9178427f2654db8">tempest-AttachVolumeTestJSON-1129991883-project-member</nova:user>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:project uuid="38ce94322c8d42b5a3dbd2af9e84c263">tempest-AttachVolumeTestJSON-1129991883</nova:project>
Aug 26 17:44:17 user nova-compute[73110]:       </nova:owner>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:44:17 user nova-compute[73110]:       <nova:ports>
Aug 26 17:44:17 user nova-compute[73110]:         <nova:port uuid="df549c20-9f92-4f6a-8ba4-90a7ea5605d0">
Aug 26 17:44:17 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 17:44:17 user nova-compute[73110]:         </nova:port>
Aug 26 17:44:17 user nova-compute[73110]:       </nova:ports>
Aug 26 17:44:17 user nova-compute[73110]:     </nova:instance>
Aug 26 17:44:17 user nova-compute[73110]:   </metadata>
Aug 26 17:44:17 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:44:17 user nova-compute[73110]:     <system>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="serial">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="uuid">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:44:17 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:44:17 user nova-compute[73110]:     </system>
Aug 26 17:44:17 user nova-compute[73110]:   </sysinfo>
Aug 26 17:44:17 user nova-compute[73110]:   <os>
Aug 26 17:44:17 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:44:17 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:44:17 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:44:17 user nova-compute[73110]:   </os>
Aug 26 17:44:17 user nova-compute[73110]:   <features>
Aug 26 17:44:17 user nova-compute[73110]:     <acpi/>
Aug 26 17:44:17 user nova-compute[73110]:     <apic/>
Aug 26 17:44:17 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:44:17 user nova-compute[73110]:   </features>
Aug 26 17:44:17 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:44:17 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:44:17 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:44:17 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:44:17 user nova-compute[73110]:   </clock>
Aug 26 17:44:17 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:44:17 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:44:17 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:44:17 user nova-compute[73110]:   </cpu>
Aug 26 17:44:17 user nova-compute[73110]:   <devices>
Aug 26 17:44:17 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:44:17 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:44:17 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk"/>
Aug 26 17:44:17 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:44:17 user nova-compute[73110]:     </disk>
Aug 26 17:44:17 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:44:17 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:44:17 user nova-compute[73110]:       <source dev="/dev/sde"/>
Aug 26 17:44:17 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:44:17 user nova-compute[73110]:       <serial>0de89c12-2d48-4021-9fac-fa17cf1aacc1</serial>
Aug 26 17:44:17 user nova-compute[73110]:     </disk>
Aug 26 17:44:17 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:44:17 user nova-compute[73110]:       <mac address="fa:16:3e:ee:a0:36"/>
Aug 26 17:44:17 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:17 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:44:17 user nova-compute[73110]:       <target dev="tapdf549c20-9f"/>
Aug 26 17:44:17 user nova-compute[73110]:     </interface>
Aug 26 17:44:17 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:44:17 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/console.log" append="off"/>
Aug 26 17:44:17 user nova-compute[73110]:     </serial>
Aug 26 17:44:17 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:44:17 user nova-compute[73110]:     <video>
Aug 26 17:44:17 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:17 user nova-compute[73110]:     </video>
Aug 26 17:44:17 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:44:17 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:44:17 user nova-compute[73110]:     </rng>
Aug 26 17:44:17 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:44:17 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:44:17 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:44:17 user nova-compute[73110]:     </memballoon>
Aug 26 17:44:17 user nova-compute[73110]:   </devices>
Aug 26 17:44:17 user nova-compute[73110]: </domain>
Aug 26 17:44:17 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:44:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Cannot resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'migration_context' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG os_vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf549c20-9f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf549c20-9f, col_values=(('external_ids', {'iface-id': 'df549c20-9f92-4f6a-8ba4-90a7ea5605d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:a0:36', 'vm-uuid': '7a5294e5-ba09-49bd-b78a-33ebc306d925'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: INFO os_vif [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:18 user nova-compute[73110]: INFO nova.compute.manager [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Terminating instance
Aug 26 17:44:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-49f21474-cfbb-4ba8-83de-6d5ca01ffc5f req-cb908fd3-4cb8-4bc3-8aaf-8f5af869cc16 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-abec89c5-7a7b-4b90-a57e-e0a49c6f40b1 req-75c6c32c-168e-4644-b2c3-59e4c7f6957a service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:20 user nova-compute[73110]: INFO nova.compute.manager [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Terminating instance
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Instance destroyed successfully.
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lazy-loading 'resources' on Instance uuid 0611d638-abf0-45f2-8708-1cc2790ffe99 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18221bdb-67, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:76:95,bridge_name='br-int',has_traffic_filtering=True,id=18221bdb-6702-49fd-8e9c-43f1b9a123b5,network=Network(76177b33-3849-46bb-8545-ae769b49a34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18221bdb-67')
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape69898df-f0, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:4d:b8,bridge_name='br-int',has_traffic_filtering=True,id=e69898df-f0e1-44ee-bbbc-0338e9962b08,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape69898df-f0')
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19cf314d-71, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=19cf314d-711b-4f86-9d51-4318829c0a19,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap19cf314d-71')
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9131187f-ab, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=9131187f-abd4-4708-ad42-090fd8510554,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9131187f-ab')
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02b2cbe2-cd, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:53:62,bridge_name='br-int',has_traffic_filtering=True,id=02b2cbe2-cd70-4478-b393-5c2a5c45127a,network=Network(be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b2cbe2-cd')
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "address": "fa:16:3e:dd:ad:23", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f63dd3-75", "ovs_interfaceid": "e7f63dd3-75b1-4e78-b4a8-e26be0a9606e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f63dd3-75, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ad:23,bridge_name='br-int',has_traffic_filtering=True,id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f63dd3-75')
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798519093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798519093',id=11,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyFZqif0G1psTR76KOGgJuKKGUijSUAMNO/cjr0SJckB+fkmpShL0K/IjWpbhcj9E41xh97MMrJ7c9sUGbHqICPWhvv6eHJAxkfvXBMwQ+Lje0hKm475oA65dHNVjO7vA==',key_name='tempest-keypair-1869521171',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c55352049ba409081025c4dbdd32074',ramdisk_id='',reservation_id='r-txujdyzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1190867397',owner_user_name='tempest-TaggedBootDevicesTest_v242-1190867397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9299ff2802e84c5aabb805a8e24a025f',uuid=0611d638-abf0-45f2-8708-1cc2790ffe99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converting VIF {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap763088fd-67, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Instance destroyed successfully.
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lazy-loading 'resources' on Instance uuid 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-691130618',display_name='tempest-TestVolumeSwap-server-691130618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-691130618',id=8,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPQXw8q8TFzIiINK2ciwNcuUPZan5sudKb1XQtY3O8sJED8wW+Ehh784jpj2qel2EjfA6AyZlqJURlkM7yyqMe/CIh/C8I3VktVTnirZx16uFjskJ+H5ERZjA7tdbs/1g==',key_name='tempest-keypair-268364097',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ae0a534fda47dbab6f087aee299812',ramdisk_id='',reservation_id='r-quay0ym0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1718376852',owner_user_name='tempest-TestVolumeSwap-1718376852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7daeea86e0294f44ade0b14af6da68bb',uuid=3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converting VIF {"id": "ae34facd-388b-4be1-952c-0b491b39b805", "address": "fa:16:3e:8c:a9:23", "network": {"id": "5a6f772c-2057-4054-9ff8-2c114183d0e2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1086393046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ae0a534fda47dbab6f087aee299812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae34facd-38", "ovs_interfaceid": "ae34facd-388b-4be1-952c-0b491b39b805", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_vif [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae34facd-38, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:0c,bridge_name='br-int',has_traffic_filtering=True,id=763088fd-674f-43b4-a3bd-eafb7f61dab6,network=Network(1972d182-cc55-4c2f-a128-b9bc0ca0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763088fd-67')
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:21 user nova-compute[73110]: INFO os_vif [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:23,bridge_name='br-int',has_traffic_filtering=True,id=ae34facd-388b-4be1-952c-0b491b39b805,network=Network(5a6f772c-2057-4054-9ff8-2c114183d0e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae34facd-38')
Aug 26 17:44:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Deleting instance files /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c_del
Aug 26 17:44:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Deletion of /opt/stack/data/nova/instances/3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c_del complete
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtBmNYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:21 user nova-compute[73110]: WARNING nova.compute.manager [req-75f9ecef-af84-4cc7-94db-d4b07e32d982 req-af54e762-089b-438f-bd4e-bda85259eaea service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-18221bdb-6702-49fd-8e9c-43f1b9a123b5 for instance with vm_state active and task_state deleting.
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe18c58-41d8-4563-a10b-5a82c567a76f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b271a1-a244-4740-95e3-802bccce0b8b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544705cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: INFO nova.compute.manager [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc33e67-354b-49e0-9bef-4d2e5339c0be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c02d3f7-94d1-49cb-a545-7487abb7f661]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed6923-0b5e-4220-ad1f-0c82321c92eb]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[658cffa4-b5ba-4ee0-9ffa-d423bb3b0394]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f5f45-4667-4dde-9e0e-6fe3a1ce85b5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3690359-0afb-4b23-a2a3-53f7da2ed8a3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260]
Aug 26 17:44:21 user nova-compute[73110]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:357ad1d8-b9fc-4095-b428-13961c121ac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cde5305-d4f8-4781-bfc6-90639aaf164d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== disconnect_volume: return (376ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eiwXMLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8d8c46-d38d-4c8a-bf68-6884311ad0c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa75eff1-5292-4514-8b68-9fc222df0262]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc (non-flash)
Aug 26 17:44:21 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544705cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bebafe-9649-44b7-a72a-fe2bfc470ed4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95ae607-508b-4b76-9f99-b45b163ab514]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39eb2bf-cc09-412f-8f9c-83a13354c898]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:21 user nova-compute[73110]: WARNING nova.compute.manager [req-3666588e-ea91-42d2-9319-180a8904fa86 req-8a623ea4-7704-4804-84f3-9360612e7b34 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e for instance with vm_state active and task_state deleting.
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbf094-ad02-4751-a4b3-28b97ea4f443]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada98f8-57e3-4ea1-8d87-c00a706f9101]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d737ab0-64b0-4c10-8ada-9a2cf12da1ad]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260]
Aug 26 17:44:21 user nova-compute[73110]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879020f1-b4ab-4aa8-ac51-9455e586f4dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[041267f8-c5a2-4eb9-add3-8ab3bfae565e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== disconnect_volume: return (317ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXPSROIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:44:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9f01d-216e-4bd7-a07d-d1c9df166415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24750c5e-7eb8-4f34-95dc-8ecefec6f71e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:22 user nova-compute[73110]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 (non-flash)
Aug 26 17:44:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544705cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ceb801-8439-4f88-8a5d-8c19fa80b852]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6e8f7b-4a44-498d-8575-2801fe83ec5f]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d9705-3794-4c5e-9e42-defd23b67402]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0665a09-7a8c-4e22-abfc-0d08859e8a35]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3134891b-a3d1-4866-b160-01fd53686029]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12173bb-1e8a-4084-8f45-d2e7564e4703]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260]
Aug 26 17:44:22 user nova-compute[73110]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0766e7-540f-4445-a110-1f55632d56c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7cf4b6-9d47-4b61-b230-1a56ea427180]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] <== disconnect_volume: return (335ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Deleting instance files /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99_del
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Deletion of /opt/stack/data/nova/instances/0611d638-abf0-45f2-8708-1cc2790ffe99_del complete
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-0cdb4d42-cab5-4c4a-92fa-5ab34e9efd59 req-d3c3b349-ea6e-49aa-93d7-1dc07ecc6550 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.compute.manager [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Took 3.63 seconds to destroy the instance on the hypervisor.
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071862.6098707, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Resumed (Lifecycle Event)
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance rebooted successfully.
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3c2e2681-c2ff-4e67-a664-2673dd3071c1 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071862.611808, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Started (Lifecycle Event)
Aug 26 17:44:22 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Took 1.32 seconds to deallocate network for instance.
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:23 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Deleted allocations for instance 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c
Aug 26 17:44:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0a019d9e-7c44-43ac-b2ef-064224e5cc6d tempest-TestVolumeSwap-1718376852 tempest-TestVolumeSwap-1718376852-project-member] Lock "3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.973s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8d3b9c9-ad38-4740-afd8-98e890fa05d6 req-554749f9-c4cb-4d22-96a6-8a7cd9533019 service nova] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Received event network-vif-deleted-ae34facd-388b-4be1-952c-0b491b39b805 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:24 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[16843817-4942-4cec-b0b1-85795f39b1b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:44:24 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8717ff93-d5e4-416e-a913-ed90f90f243c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-e69898df-f0e1-44ee-bbbc-0338e9962b08 for instance with vm_state active and task_state deleting.
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-19cf314d-711b-4f86-9d51-4318829c0a19 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-19cf314d-711b-4f86-9d51-4318829c0a19 for instance with vm_state active and task_state deleting.
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-9131187f-abd4-4708-ad42-090fd8510554 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING nova.compute.manager [req-d7719a40-bd3d-4fb7-8ca2-e520395be4b7 req-c73a7b49-44dc-439c-9905-8d11d77f2348 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-9131187f-abd4-4708-ad42-090fd8510554 for instance with vm_state active and task_state deleting.
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864bc02-f798-4200-b9a0-7e8c0828f3a5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90565d-0fab-46d5-8598-4c68ed135383]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72960db2-2456-414f-9003-7f06d678067b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OknhLjMC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac56e6f-d1c0-4bbd-8a6f-dd825a708f5f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4658cd-a857-4d3d-a022-ccfabeb4fd9b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[53baf700-8610-497b-ad79-0f17e478ec23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:44:24 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1da410-85a8-4d4f-b9db-8dde75454033]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[41871623-ad30-4215-b7d5-cd1fedc9ddba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd849076-05d3-4591-bf16-1f260b6a1308]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:44:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.277s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:25 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.054s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:25 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'flavor' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6192506-02c5-4ae1-a191-e62cd9378e90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:44:25 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:44:25 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:44:25 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:44:25 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:44:25 user nova-compute[73110]:   <serial>61dd01de-405d-4b62-bd9f-096e972d7e16</serial>
Aug 26 17:44:25 user nova-compute[73110]: </disk>
Aug 26 17:44:25 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fdd705-960f-4c3f-aaa7-0f65786984a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9] added
Aug 26 17:44:25 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.095s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cb97da-bf45-4181-8532-68a6f0c0862d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-deleted-e7f63dd3-75b1-4e78-b4a8-e26be0a9606e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: INFO nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Neutron deleted interface e7f63dd3-75b1-4e78-b4a8-e26be0a9606e; detaching it from the instance and deleting it from the info cache
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "address": "fa:16:3e:9e:1f:0c", "network": {"id": "1972d182-cc55-4c2f-a128-b9bc0ca0497a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1863466894", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763088fd-67", "ovs_interfaceid": "763088fd-674f-43b4-a3bd-eafb7f61dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91129c2a-a0c3-4fed-8679-2b256963e986]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIiZyvfr {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIiZyvfr" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6669c98d-f48e-44a8-88bc-884918d0d209]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIiZyvfr'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Detach interface failed, port_id=e7f63dd3-75b1-4e78-b4a8-e26be0a9606e, reason: Instance 0611d638-abf0-45f2-8708-1cc2790ffe99 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-deleted-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: INFO nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Neutron deleted interface 763088fd-674f-43b4-a3bd-eafb7f61dab6; detaching it from the instance and deleting it from the info cache
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [{"id": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "address": "fa:16:3e:e3:76:95", "network": {"id": "76177b33-3849-46bb-8545-ae769b49a34c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915189079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18221bdb-67", "ovs_interfaceid": "18221bdb-6702-49fd-8e9c-43f1b9a123b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "address": "fa:16:3e:60:4d:b8", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape69898df-f0", "ovs_interfaceid": "e69898df-f0e1-44ee-bbbc-0338e9962b08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "19cf314d-711b-4f86-9d51-4318829c0a19", "address": "fa:16:3e:56:e2:3a", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cf314d-71", "ovs_interfaceid": "19cf314d-711b-4f86-9d51-4318829c0a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9131187f-abd4-4708-ad42-090fd8510554", "address": "fa:16:3e:81:2d:dc", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9131187f-ab", "ovs_interfaceid": "9131187f-abd4-4708-ad42-090fd8510554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "address": "fa:16:3e:6b:53:62", "network": {"id": "be6a7f36-05b6-4fb9-ba5c-0a0df4cc65ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-287686275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c55352049ba409081025c4dbdd32074", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b2cbe2-cd", "ovs_interfaceid": "02b2cbe2-cd70-4478-b393-5c2a5c45127a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3259e631-5365-46f8-b781-aebf7c5e4991]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e51d1b3-9d9c-4333-a5c6-031c0a73585c req-94dddc7b-f566-4528-85e9-470a388df8d5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Detach interface failed, port_id=763088fd-674f-43b4-a3bd-eafb7f61dab6, reason: Instance 0611d638-abf0-45f2-8708-1cc2790ffe99 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ece236-26e9-4371-906c-a10b77e413f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02db6ae-e17d-45f9-8730-c567b81a75fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260]
Aug 26 17:44:26 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca39997-70c7-49dd-8241-74ff25c7335f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf1c66-e46d-4285-bd40-ce885df1c961]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7156f04-9222-4551-9bf7-91f154db2dad]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No VIF found with MAC fa:16:3e:58:9f:3c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: WARNING nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-02b2cbe2-cd70-4478-b393-5c2a5c45127a for instance with vm_state active and task_state deleting.
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-unplugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-unplugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] No waiting events found dispatching network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: WARNING nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received unexpected event network-vif-plugged-763088fd-674f-43b4-a3bd-eafb7f61dab6 for instance with vm_state active and task_state deleting.
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: WARNING nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state None.
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:26 user nova-compute[73110]: WARNING nova.compute.manager [req-0ec230bc-8f00-4891-b651-6bc8fc94a8ee req-f3cce90d-3c39-4fd1-b5d1-193a43b209c7 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state None.
Aug 26 17:44:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-211b58d7-82d6-4e76-a115-6bd54145aaeb tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] <== connect_volume: return (2815ms) {'type': 'block', 'scsi_wwn': '26431633837323738', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431633837323738', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'flavor' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:44:27 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:44:27 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:44:27 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:44:27 user nova-compute[73110]:   <serial>16ce92dd-4c14-4812-96fa-f01590e810a9</serial>
Aug 26 17:44:27 user nova-compute[73110]: </disk>
Aug 26 17:44:27 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:27 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Took 5.04 seconds to deallocate network for instance.
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No VIF found with MAC fa:16:3e:3f:73:c7, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:44:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-04c2e2e2-493b-4862-86c4-35c51f2b56ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.119s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-80a46db8-c2c7-4296-a09b-7aefe4dd0efb req-7108284b-69f2-4803-8147-e08368a36ba5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-deleted-18221bdb-6702-49fd-8e9c-43f1b9a123b5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-80a46db8-c2c7-4296-a09b-7aefe4dd0efb req-7108284b-69f2-4803-8147-e08368a36ba5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-deleted-9131187f-abd4-4708-ad42-090fd8510554 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-80a46db8-c2c7-4296-a09b-7aefe4dd0efb req-7108284b-69f2-4803-8147-e08368a36ba5 service nova] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Received event network-vif-deleted-02b2cbe2-cd70-4478-b393-5c2a5c45127a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:29 user nova-compute[73110]: INFO nova.compute.manager [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Rescuing
Aug 26 17:44:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Stashing vm_state: active {{(pid=73110) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:44:29 user nova-compute[73110]: INFO nova.compute.claims [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Claim successful on node user
Aug 26 17:44:29 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating resource usage from migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.569s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:30 user nova-compute[73110]: INFO nova.compute.manager [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Migrating
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:30 user nova-compute[73110]: INFO nova.compute.rpcapi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:30 user nova-compute[73110]: WARNING nova.compute.manager [req-05848d81-2e1f-46a3-a6c0-af2dfc8561a7 req-cbe6377a-a305-493d-8553-51e03ebbc6fa service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:30 user nova-compute[73110]: INFO nova.compute.manager [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Took 3.17 seconds to detach 3 volumes for instance.
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance destroyed successfully.
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:31 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attempting a stable device rescue
Aug 26 17:44:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 17:44:31 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Deleted allocations for instance 0611d638-abf0-45f2-8708-1cc2790ffe99
Aug 26 17:44:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:44:31 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Creating image(s)
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "f04615a7ecad70137522948372f2538f6ae84c3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f04615a7ecad70137522948372f2538f6ae84c3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44467aa4-2a6c-4b96-913c-5008f1aa53ad tempest-TaggedBootDevicesTest_v242-1190867397 tempest-TaggedBootDevicesTest_v242-1190867397-project-member] Lock "0611d638-abf0-45f2-8708-1cc2790ffe99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.674s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.part --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.virt.images [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] 8fba27bd-0ec3-459e-a9c1-2251db2445e5 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.part /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:32 user nova-compute[73110]: WARNING nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:32 user nova-compute[73110]: WARNING nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:32 user nova-compute[73110]: WARNING nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:32 user nova-compute[73110]: WARNING nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:32 user nova-compute[73110]: WARNING nova.compute.manager [req-51b502b5-4fc8-4e1a-a6e6-5432704dfe9e req-30e8ed8a-cdd4-45d5-aba7-2c42a54d686c service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:32 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.part /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.converted" returned: 0 in 0.545s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Starting migrate_disk_and_power_off {{(pid=73110) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f04615a7ecad70137522948372f2538f6ae84c3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.079s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "f04615a7ecad70137522948372f2538f6ae84c3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f04615a7ecad70137522948372f2538f6ae84c3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c,backing_fmt=raw /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c,backing_fmt=raw /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue" returned: 0 in 0.062s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "f04615a7ecad70137522948372f2538f6ae84c3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'migration_context' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:33 user nova-compute[73110]: WARNING nova.compute.manager [req-34c3f8f0-793b-4975-8e8a-a097aa56c03c req-a25c1602-d528-4a8f-b471-bfe16f3acadb service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state resize_migrating.
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Object Instance<2207fd05-7b0c-4b99-bad7-46c1707ec1bc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start _get_guest_xml network_info=[{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "vif_mac": "fa:16:3e:3f:73:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8fba27bd-0ec3-459e-a9c1-2251db2445e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9a12ecd6-d788-41e0-94ae-2197069613ab', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2207fd05-7b0c-4b99-bad7-46c1707ec1bc', 'attached_at': '', 'detached_at': '', 'volume_id': '16ce92dd-4c14-4812-96fa-f01590e810a9', 'serial': '16ce92dd-4c14-4812-96fa-f01590e810a9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'resources' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Object Instance<2207fd05-7b0c-4b99-bad7-46c1707ec1bc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'numa_topology' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Object Instance<2207fd05-7b0c-4b99-bad7-46c1707ec1bc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:33 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:33 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.objects.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Object Instance<2207fd05-7b0c-4b99-bad7-46c1707ec1bc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:33 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:33 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:33 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc73fe7-0633-4ad8-83f6-5bfffd93d066]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gIiZyvfr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 17:44:33 user nova-compute[73110]: node.name = iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9
Aug 26 17:44:33 user nova-compute[73110]: node.tpgt = -1
Aug 26 17:44:33 user nova-compute[73110]: node.startup = automatic
Aug 26 17:44:33 user nova-compute[73110]: node.leading_login = No
Aug 26 17:44:33 user nova-compute[73110]: iface.iscsi_ifacename = default
Aug 26 17:44:33 user nova-compute[73110]: iface.net_ifacename = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.ipaddress = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.prefix_len = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.hwaddress = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.transport_name = tcp
Aug 26 17:44:33 user nova-compute[73110]: iface.initiatorname = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.vlan_id = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.vlan_priority = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.vlan_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.iface_num = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.mtu = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.port = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.bootproto = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.subnet_mask = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.gateway = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_alt_client_id = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_dns = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_learn_iqn = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_vendor_id_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_vendor_id = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.dhcp_slp_da = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.fragmentation = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.gratuitous_arp = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.incoming_forwarding = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.tos_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.tos = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.ttl = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.delayed_ack = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.tcp_nagle = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.tcp_wsf_state = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.tcp_wsf = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.tcp_timer_scale = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.tcp_timestamp = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.redirect = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.def_task_mgmt_timeout = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.header_digest = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.data_digest = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.immediate_data = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.initial_r2t = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.data_seq_inorder = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.data_pdu_inorder = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.erl = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.max_receive_data_len = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.first_burst_len = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.max_outstanding_r2t = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.max_burst_len = 0
Aug 26 17:44:33 user nova-compute[73110]: iface.chap_auth = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.bidi_chap = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.strict_login_compliance = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.discovery_auth = <empty>
Aug 26 17:44:33 user nova-compute[73110]: iface.discovery_logout = <empty>
Aug 26 17:44:33 user nova-compute[73110]: node.discovery_address = <empty>
Aug 26 17:44:33 user nova-compute[73110]: node.discovery_port = 0
Aug 26 17:44:33 user nova-compute[73110]: node.discovery_type = static
Aug 26 17:44:33 user nova-compute[73110]: node.session.initial_cmdsn = 0
Aug 26 17:44:33 user nova-compute[73110]: node.session.initial_login_retry_max = 8
Aug 26 17:44:33 user nova-compute[73110]: node.session.xmit_thread_priority = -20
Aug 26 17:44:33 user nova-compute[73110]: node.session.cmds_max = 128
Aug 26 17:44:33 user nova-compute[73110]: node.session.queue_depth = 32
Aug 26 17:44:33 user nova-compute[73110]: node.session.nr_sessions = 1
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.authmethod = CHAP
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.username = gIiZyvfr
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.password = ***
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.username_in = <empty>
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.password_in = <empty>
Aug 26 17:44:33 user nova-compute[73110]: node.session.auth.chap_algs = MD5
Aug 26 17:44:33 user nova-compute[73110]: node.session.timeo.replacement_timeout = 120
Aug 26 17:44:33 user nova-compute[73110]: node.session.err_timeo.abort_timeout = 15
Aug 26 17:44:33 user nova-compute[73110]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 17:44:33 user nova-compute[73110]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 17:44:33 user nova-compute[73110]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.FastAbort = Yes
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.InitialR2T = No
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.ImmediateData = Yes
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.MaxConnections = 1
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 17:44:33 user nova-compute[73110]: node.session.iscsi.ERL = 0
Aug 26 17:44:33 user nova-compute[73110]: node.session.scan = manual
Aug 26 17:44:33 user nova-compute[73110]: node.session.reopen_max = 0
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].address = 172.16.0.220
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].port = 3260
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].startup = manual
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].tcp.window_size = 524288
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].tcp.type_of_service = 0
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].timeo.logout_timeout = 15
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].timeo.login_timeout = 15
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].timeo.auth_timeout = 45
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.DataDigest = None
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.IFMarker = No
Aug 26 17:44:33 user nova-compute[73110]: node.conn[0].iscsi.OFMarker = No
Aug 26 17:44:33 user nova-compute[73110]: # END RECORD
Aug 26 17:44:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[87399863-fad4-4e72-918f-ebc960432b47]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f5310-1429-4226-bbc6-f932e0e78b35]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIiZyvfr {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIiZyvfr" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb09e7-be9b-4e28-a5b5-2787b463c0fc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIiZyvfr'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87603f2-811a-42c4-b93b-4c1c8c19102d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a0579e-c9ae-44da-a2e3-eaad7f5ae6a1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a59de06-3fcb-4092-be1d-69715a39d346]: (4, ('0 0 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] <== connect_volume: return (222ms) {'type': 'block', 'scsi_wwn': '26431633837323738', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431633837323738', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:44:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance destroyed successfully.
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc99d4df-9d, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-888669765',display_name='tempest-ServerStableDeviceRescueTest-server-888669765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-888669765',id=4,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbuFk+K1pxZR9a4QvkWecbUi3JuCbGRz7lFcJX3ParM12ZMFodvkAui0Sq9NhYW1f+r5L73YYv1YVCMiB80dvvwaNpeAm9ThsOnzEsXu6/7/ENeE7J5wD/bjJwTv4BBQ==',key_name='tempest-keypair-38390506',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='698cfee557244870b583fadf02e52a69',ramdisk_id='',reservation_id='r-pamlg4rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-281478421',owner_user_name='tempest-ServerStableDeviceRescueTest-281478421-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952334e4f9ae44ba841a0b8f200a56ea',uuid=2207fd05-7b0c-4b99-bad7-46c1707ec1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "vif_mac": "fa:16:3e:3f:73:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converting VIF {"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "vif_mac": "fa:16:3e:3f:73:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'pci_devices' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:34 user nova-compute[73110]: INFO os_vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:34 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.objects.base [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Object Instance<2207fd05-7b0c-4b99-bad7-46c1707ec1bc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:44:34 user nova-compute[73110]:   <uuid>2207fd05-7b0c-4b99-bad7-46c1707ec1bc</uuid>
Aug 26 17:44:34 user nova-compute[73110]:   <name>instance-00000004</name>
Aug 26 17:44:34 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:44:34 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:44:34 user nova-compute[73110]:   <metadata>
Aug 26 17:44:34 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:44:34 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-888669765</nova:name>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:44:33</nova:creationTime>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:44:34 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:44:34 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:owner>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:user uuid="952334e4f9ae44ba841a0b8f200a56ea">tempest-ServerStableDeviceRescueTest-281478421-project-member</nova:user>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:project uuid="698cfee557244870b583fadf02e52a69">tempest-ServerStableDeviceRescueTest-281478421</nova:project>
Aug 26 17:44:34 user nova-compute[73110]:       </nova:owner>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:44:34 user nova-compute[73110]:       <nova:ports>
Aug 26 17:44:34 user nova-compute[73110]:         <nova:port uuid="215e0790-c265-4add-b5be-a21efa2c1bd4">
Aug 26 17:44:34 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:44:34 user nova-compute[73110]:         </nova:port>
Aug 26 17:44:34 user nova-compute[73110]:       </nova:ports>
Aug 26 17:44:34 user nova-compute[73110]:     </nova:instance>
Aug 26 17:44:34 user nova-compute[73110]:   </metadata>
Aug 26 17:44:34 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:44:34 user nova-compute[73110]:     <system>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="serial">2207fd05-7b0c-4b99-bad7-46c1707ec1bc</entry>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="uuid">2207fd05-7b0c-4b99-bad7-46c1707ec1bc</entry>
Aug 26 17:44:34 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:44:34 user nova-compute[73110]:     </system>
Aug 26 17:44:34 user nova-compute[73110]:   </sysinfo>
Aug 26 17:44:34 user nova-compute[73110]:   <os>
Aug 26 17:44:34 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:44:34 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:44:34 user nova-compute[73110]:   </os>
Aug 26 17:44:34 user nova-compute[73110]:   <features>
Aug 26 17:44:34 user nova-compute[73110]:     <acpi/>
Aug 26 17:44:34 user nova-compute[73110]:     <apic/>
Aug 26 17:44:34 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:44:34 user nova-compute[73110]:   </features>
Aug 26 17:44:34 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:44:34 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:44:34 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:44:34 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:44:34 user nova-compute[73110]:   </clock>
Aug 26 17:44:34 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:44:34 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:44:34 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:44:34 user nova-compute[73110]:   </cpu>
Aug 26 17:44:34 user nova-compute[73110]:   <devices>
Aug 26 17:44:34 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:44:34 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:44:34 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk"/>
Aug 26 17:44:34 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:44:34 user nova-compute[73110]:     </disk>
Aug 26 17:44:34 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:44:34 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:44:34 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 17:44:34 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:44:34 user nova-compute[73110]:       <serial>16ce92dd-4c14-4812-96fa-f01590e810a9</serial>
Aug 26 17:44:34 user nova-compute[73110]:     </disk>
Aug 26 17:44:34 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:44:34 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:44:34 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue"/>
Aug 26 17:44:34 user nova-compute[73110]:       <target dev="vdc" bus="virtio"/>
Aug 26 17:44:34 user nova-compute[73110]:       <boot order="1"/>
Aug 26 17:44:34 user nova-compute[73110]:     </disk>
Aug 26 17:44:34 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:44:34 user nova-compute[73110]:       <mac address="fa:16:3e:3f:73:c7"/>
Aug 26 17:44:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:34 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:44:34 user nova-compute[73110]:       <target dev="tap215e0790-c2"/>
Aug 26 17:44:34 user nova-compute[73110]:     </interface>
Aug 26 17:44:34 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:44:34 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/console.log" append="off"/>
Aug 26 17:44:34 user nova-compute[73110]:     </serial>
Aug 26 17:44:34 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:44:34 user nova-compute[73110]:     <video>
Aug 26 17:44:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:34 user nova-compute[73110]:     </video>
Aug 26 17:44:34 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:44:34 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:44:34 user nova-compute[73110]:     </rng>
Aug 26 17:44:34 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:44:34 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:44:34 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:44:34 user nova-compute[73110]:     </memballoon>
Aug 26 17:44:34 user nova-compute[73110]:   </devices>
Aug 26 17:44:34 user nova-compute[73110]: </domain>
Aug 26 17:44:34 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc80f35-3f6c-473f-84b8-7f34cc1abb4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance destroyed successfully.
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09cfe7-b5ac-4d91-a53c-92eb36cea919]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441ab880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc49510-d890-42c1-a549-bb2cc33733b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3472a-b44b-4f74-91a6-60aef2b44120]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] No VIF found with MAC fa:16:3e:3f:73:c7, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd75d72-8a62-4d3f-9b6d-5be72a09874e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce73f6-0db4-4bec-a669-f30ff5187f82]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22b10f-8ee8-4e2f-b07d-f10b5047bd09]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9574400d-426e-4c08-85f9-71953d4c3615]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:44:34 user nova-compute[73110]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e27500-1489-4156-8524-d569bc8346e3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== disconnect_volume: return (323ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:44:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_resize/disk /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "cp -r /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_resize/disk /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk" returned: 0 in 0.493s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_resize/disk.info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk.info {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "cp -r /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_resize/disk.info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk.info" returned: 0 in 0.034s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071860.7354202, 0611d638-abf0-45f2-8708-1cc2790ffe99 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:35 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] VM Stopped (Lifecycle Event)
Aug 26 17:44:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-03b14815-7b24-46a9-875f-64de21c55958 None None] [instance: 0611d638-abf0-45f2-8708-1cc2790ffe99] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:35 user nova-compute[73110]: WARNING nova.compute.manager [req-51dc1092-7895-4880-9a96-a6014a42eac0 req-ad2ee8e8-6479-49a0-a463-718ebb5a4bd0 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state resize_migrating.
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:36 user nova-compute[73110]: WARNING nova.compute.manager [req-6f1e24b5-e796-48b7-885c-967345d9a5bc req-6672ac0b-ab3d-4c6f-b91e-de047bef530f service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071861.2363229, 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:36 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] VM Stopped (Lifecycle Event)
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-35df96ad-9112-406b-9032-3d937f24098c None None] [instance: 3b4b98b6-d3c2-4cf4-a61b-1900f6481e5c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Port bc99d4df-9d70-45f8-ba11-6965e6f146dc binding to destination host user is already ACTIVE {{(pid=73110) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:44:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.utils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6205c77-9edc-4b9b-a8d7-8940d7016a48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f62c9-56c2-4e11-9637-1c6e7e8500aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c2b14-5c6c-470a-830d-ee5729829870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f770ad-5269-4ecb-8d5a-d811193e94d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:44:37 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:44:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da2039a-3e3f-4bb9-a9eb-20c75abb0189]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:44:37 user nova-compute[73110]: DEBUG os_brick.utils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:38 user nova-compute[73110]: WARNING nova.compute.manager [req-2b4ddb8b-bfff-4be8-83e9-29e3cf8bc13d req-60fa574e-38df-4c8b-9ba7-8957c5537ee7 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state rescuing.
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 2207fd05-7b0c-4b99-bad7-46c1707ec1bc due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071878.1621842, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Resumed (Lifecycle Event)
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7e526789-e9b7-4dbd-a34a-d2cbbb9b95c6 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071878.16833, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Started (Lifecycle Event)
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:44:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:49 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071874.135799, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:49 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Stopped (Lifecycle Event)
Aug 26 17:44:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-257594f7-30a7-4c4f-b658-899890ffb20a None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-257594f7-30a7-4c4f-b658-899890ffb20a None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:49 user nova-compute[73110]: INFO nova.compute.manager [None req-257594f7-30a7-4c4f-b658-899890ffb20a None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:44:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Starting finish_migration {{(pid=73110) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:44:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Creating image(s)
Aug 26 17:44:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk. size=21474836480 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk 21474836480 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk 21474836480" returned: 0 in 0.238s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Ensure instance console log exists: /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start _get_guest_xml network_info=[{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5f27d3f1-99db-4a7a-bc87-966c4204961a', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84d42b86-03a9-496c-85bd-e643ea8ab023', 'attached_at': '2023-08-26T17:44:50.000000', 'detached_at': '', 'volume_id': '61dd01de-405d-4b62-bd9f-096e972d7e16', 'serial': '61dd01de-405d-4b62-bd9f-096e972d7e16'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:51 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:51 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:51 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:44:51 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e58817f-627a-405e-ac79-2fd4a7f9114c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:44:51 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e0457-5532-4b68-af21-2c47945d7f8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b2dc3-22e2-4e1f-8f46-b93870671fb3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e5d97-760f-46ff-938a-29ee4a8c06ba]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5224d-4d3b-43ba-8c0b-8f43b4166c3a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OknhLjMC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a598140-de73-4446-8e54-cc0e682f30c8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457948f-0602-46fd-bcc7-9e623e904f34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bddbcf-6c9d-4620-95a8-1bd15f3c4e33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:44:51 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f250f-c4ad-41db-99c0-781ae3a6fa5f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc7ad31-581b-4c1d-b179-16baac737c93]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:44:51 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a21103-ae6c-4bcd-a2c1-32eb7be37928]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:44:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:44:52 user nova-compute[73110]:   <uuid>84d42b86-03a9-496c-85bd-e643ea8ab023</uuid>
Aug 26 17:44:52 user nova-compute[73110]:   <name>instance-00000003</name>
Aug 26 17:44:52 user nova-compute[73110]:   <memory>2097152</memory>
Aug 26 17:44:52 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:44:52 user nova-compute[73110]:   <metadata>
Aug 26 17:44:52 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:44:52 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherB-server-332987352</nova:name>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:44:51</nova:creationTime>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:flavor name="m1.small">
Aug 26 17:44:52 user nova-compute[73110]:         <nova:memory>2048</nova:memory>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:disk>20</nova:disk>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:44:52 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:owner>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:user uuid="72e7c15b85554d30915b4957791d2d54">tempest-ServerActionsTestOtherB-453496732-project-member</nova:user>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:project uuid="aed9258ba923464ba423b3b9751f56cc">tempest-ServerActionsTestOtherB-453496732</nova:project>
Aug 26 17:44:52 user nova-compute[73110]:       </nova:owner>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:44:52 user nova-compute[73110]:       <nova:ports>
Aug 26 17:44:52 user nova-compute[73110]:         <nova:port uuid="bc99d4df-9d70-45f8-ba11-6965e6f146dc">
Aug 26 17:44:52 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:44:52 user nova-compute[73110]:         </nova:port>
Aug 26 17:44:52 user nova-compute[73110]:       </nova:ports>
Aug 26 17:44:52 user nova-compute[73110]:     </nova:instance>
Aug 26 17:44:52 user nova-compute[73110]:   </metadata>
Aug 26 17:44:52 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:44:52 user nova-compute[73110]:     <system>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="serial">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="uuid">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:44:52 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:44:52 user nova-compute[73110]:     </system>
Aug 26 17:44:52 user nova-compute[73110]:   </sysinfo>
Aug 26 17:44:52 user nova-compute[73110]:   <os>
Aug 26 17:44:52 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:44:52 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:44:52 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:44:52 user nova-compute[73110]:   </os>
Aug 26 17:44:52 user nova-compute[73110]:   <features>
Aug 26 17:44:52 user nova-compute[73110]:     <acpi/>
Aug 26 17:44:52 user nova-compute[73110]:     <apic/>
Aug 26 17:44:52 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:44:52 user nova-compute[73110]:   </features>
Aug 26 17:44:52 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:44:52 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:44:52 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:44:52 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:44:52 user nova-compute[73110]:   </clock>
Aug 26 17:44:52 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:44:52 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:44:52 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:44:52 user nova-compute[73110]:   </cpu>
Aug 26 17:44:52 user nova-compute[73110]:   <devices>
Aug 26 17:44:52 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:44:52 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:44:52 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk"/>
Aug 26 17:44:52 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:44:52 user nova-compute[73110]:     </disk>
Aug 26 17:44:52 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:44:52 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:44:52 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:44:52 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:44:52 user nova-compute[73110]:       <serial>61dd01de-405d-4b62-bd9f-096e972d7e16</serial>
Aug 26 17:44:52 user nova-compute[73110]:     </disk>
Aug 26 17:44:52 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:44:52 user nova-compute[73110]:       <mac address="fa:16:3e:58:9f:3c"/>
Aug 26 17:44:52 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:52 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:44:52 user nova-compute[73110]:       <target dev="tapbc99d4df-9d"/>
Aug 26 17:44:52 user nova-compute[73110]:     </interface>
Aug 26 17:44:52 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:44:52 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/console.log" append="off"/>
Aug 26 17:44:52 user nova-compute[73110]:     </serial>
Aug 26 17:44:52 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:44:52 user nova-compute[73110]:     <video>
Aug 26 17:44:52 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:44:52 user nova-compute[73110]:     </video>
Aug 26 17:44:52 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:44:52 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:44:52 user nova-compute[73110]:     </rng>
Aug 26 17:44:52 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:44:52 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:44:52 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:44:52 user nova-compute[73110]:     </memballoon>
Aug 26 17:44:52 user nova-compute[73110]:   </devices>
Aug 26 17:44:52 user nova-compute[73110]: </domain>
Aug 26 17:44:52 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1186087000-network", "vif_mac": "fa:16:3e:58:9f:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG os_vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc99d4df-9d, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc99d4df-9d, col_values=(('external_ids', {'iface-id': 'bc99d4df-9d70-45f8-ba11-6965e6f146dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:9f:3c', 'vm-uuid': '84d42b86-03a9-496c-85bd-e643ea8ab023'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:52 user nova-compute[73110]: INFO os_vif [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:44:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] No VIF found with MAC fa:16:3e:58:9f:3c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:44:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:54 user nova-compute[73110]: WARNING nova.compute.manager [req-05261368-455b-4ccd-b7bd-ae9f75d3cce0 req-dde07cde-36f2-4b23-b053-88b253309a9c service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state resize_finish.
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071896.4463108, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Resumed (Lifecycle Event)
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:44:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance running successfully.
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Failed to set time: agent not configured {{(pid=73110) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9c46c26-a585-4322-90f0-e84f3a04cdcf tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] finish_migration finished successfully. {{(pid=73110) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071896.446751, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:44:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Started (Lifecycle Event)
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:44:56 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:44:56 user nova-compute[73110]: WARNING nova.compute.manager [req-09beb9fe-0857-4562-9422-1840ee490a38 req-96e661e5-fa0b-47a6-8887-98adf8f042d2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state resize_finish.
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:44:57 user nova-compute[73110]: INFO nova.compute.claims [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Claim successful on node user
Aug 26 17:44:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:44:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:44:58 user nova-compute[73110]: INFO nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Booting with volume 640e900b-27b9-409c-b9a3-889be0768f9a at /dev/vda
Aug 26 17:44:58 user nova-compute[73110]: DEBUG nova.policy [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41b4e420b9054bc7ba61d6650aa255b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94497159fb204730a1e1caa4cbd1c4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb1e1e7-712e-4b51-8721-5aa6c27b5094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d117fde-bdd0-4194-9508-8a6a9ae38e9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[699314bd-1b74-49c9-82a7-7a04e658ac1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a424f41-208a-42b6-baae-bcac07274558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:44:58 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f544a1b-9743-42dc-b8f1-c99484e87c0c]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating existing volume attachment record: f41a92a8-9e49-4fe8-a84c-13a5a1d09dbd {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully created port: bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully created port: 130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:44:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully created port: a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:00 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:00 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.462509155273438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Applying migration context for instance 84d42b86-03a9-496c-85bd-e643ea8ab023 as it has an incoming, in-progress migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12. Migration status is finished {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 17:45:01 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating resource usage from migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 253d1925-ec97-480f-b99b-68942d327b69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully created port: 737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:45:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully created port: e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:45:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-bdf99d67-c2bc-48b8-a630-e41da0f43ae1. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:45:05 user nova-compute[73110]: DEBUG nova.network.neutron [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-310a2886-66a0-4c28-a83e-89c9ff41bacd req-be5dd88a-61e2-463c-b0ef-015069d76c81 service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:05 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: 832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-832ca559-80a3-4851-ae44-a800f04ed67f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.network.neutron [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port 832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.network.neutron [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: 2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG nova.network.neutron [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4d33fcc4-a487-4112-95b9-1a09e439e9d6 req-bacf592b-37a3-456a-bcd7-1ed042abda41 service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:07 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: 130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-2ee5d5cb-a2d2-467e-b649-41b68830a249. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port 2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:08 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-130ca0c1-6df7-489b-b320-806099d3c26b. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port 130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG nova.network.neutron [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-74a0c717-c365-4ce0-82d4-8a1aae6bd2f2 req-e6e82c1c-2a4c-4b5b-b8f2-506fd377122f service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: 737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-a43208c1-62da-4efa-b040-4f7e47e8b34a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-737d387c-f6ef-456b-9e6d-9bc2819bdf98. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port 737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-53987d8b-7145-432d-a2a5-70fd3b8fc4a7 req-ea0054d6-99b9-4dec-aec4-05817776f19f service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Successfully updated port: e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-e667c685-08c3-4b5d-882b-c1cddecb161e. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:14 user nova-compute[73110]: INFO nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Booting with volume e141ab67-8feb-43d2-8976-4954fc9bf1e2 at /dev/vdb
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[38308fa0-b5d2-410e-818c-efba34918603]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2e200-30d4-4df1-832c-a7baec3e98be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[73164bfb-8ab9-4bc1-bd01-03a1d43ed2bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d4ea0-b1c6-4a7c-88e8-5d5267a6db8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:14 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:45:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f94f1c-d52c-43f6-803b-eed47e669000]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating existing volume attachment record: c86de8a6-bfa7-4a83-9704-bd3cdd871891 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:45:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance network_info: |[{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:45:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:16 user nova-compute[73110]: DEBUG nova.network.neutron [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updated VIF entry in instance network info cache for port e667c685-08c3-4b5d-882b-c1cddecb161e. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:45:16 user nova-compute[73110]: DEBUG nova.network.neutron [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f6bb83db-0707-46e9-9783-70a84cb7babf req-f32c163f-1654-40ce-8106-d9bf4479af5e service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:45:18 user nova-compute[73110]: INFO nova.compute.claims [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Claim successful on node user
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:45:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.policy [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4f2d956017b4782a5db5b60ff5106d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b35bd237a204d0c9f8d3dffbc755653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:45:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Creating image(s)
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.215s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk 1073741824" returned: 0 in 0.065s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Cannot resize image /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Ensure instance console log exists: /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Successfully created port: 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Successfully updated port: 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing instance network info cache due to event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance network_info: |[{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start _get_guest_xml network_info=[{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:45:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiQhqTDtKrFX1L/2k2BPbeFPcIx9Dqv0wygQtrma1XCnxRE2QRpxl/L3gRfi7ZNWt9BNE+kb42vyxBj9a2nDWN8/Og4gyoZy2aQUo+1M1nags1woJmceUS+SEb9dtSGPA==',key_name='tempest-keypair-1356496581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_devices' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:45:22 user nova-compute[73110]:   <uuid>e277fb69-1fba-42da-98f6-7b55b892788e</uuid>
Aug 26 17:45:22 user nova-compute[73110]:   <name>instance-0000000f</name>
Aug 26 17:45:22 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:45:22 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:45:22 user nova-compute[73110]:   <metadata>
Aug 26 17:45:22 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:45:22 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2001790373</nova:name>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:45:22</nova:creationTime>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:45:22 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:45:22 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:owner>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:user uuid="a4f2d956017b4782a5db5b60ff5106d1">tempest-AttachVolumeShelveTestJSON-90237160-project-member</nova:user>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:project uuid="8b35bd237a204d0c9f8d3dffbc755653">tempest-AttachVolumeShelveTestJSON-90237160</nova:project>
Aug 26 17:45:22 user nova-compute[73110]:       </nova:owner>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:45:22 user nova-compute[73110]:       <nova:ports>
Aug 26 17:45:22 user nova-compute[73110]:         <nova:port uuid="022f585c-5ca8-414c-b0cd-59c98b2f1254">
Aug 26 17:45:22 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 17:45:22 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:22 user nova-compute[73110]:       </nova:ports>
Aug 26 17:45:22 user nova-compute[73110]:     </nova:instance>
Aug 26 17:45:22 user nova-compute[73110]:   </metadata>
Aug 26 17:45:22 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:45:22 user nova-compute[73110]:     <system>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="serial">e277fb69-1fba-42da-98f6-7b55b892788e</entry>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="uuid">e277fb69-1fba-42da-98f6-7b55b892788e</entry>
Aug 26 17:45:22 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:45:22 user nova-compute[73110]:     </system>
Aug 26 17:45:22 user nova-compute[73110]:   </sysinfo>
Aug 26 17:45:22 user nova-compute[73110]:   <os>
Aug 26 17:45:22 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:45:22 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:45:22 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:45:22 user nova-compute[73110]:   </os>
Aug 26 17:45:22 user nova-compute[73110]:   <features>
Aug 26 17:45:22 user nova-compute[73110]:     <acpi/>
Aug 26 17:45:22 user nova-compute[73110]:     <apic/>
Aug 26 17:45:22 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:45:22 user nova-compute[73110]:   </features>
Aug 26 17:45:22 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:45:22 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:45:22 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:45:22 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:45:22 user nova-compute[73110]:   </clock>
Aug 26 17:45:22 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:45:22 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:45:22 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:45:22 user nova-compute[73110]:   </cpu>
Aug 26 17:45:22 user nova-compute[73110]:   <devices>
Aug 26 17:45:22 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:45:22 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:45:22 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk"/>
Aug 26 17:45:22 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:45:22 user nova-compute[73110]:     </disk>
Aug 26 17:45:22 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:22 user nova-compute[73110]:       <mac address="fa:16:3e:9c:62:e1"/>
Aug 26 17:45:22 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:22 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:22 user nova-compute[73110]:       <target dev="tap022f585c-5c"/>
Aug 26 17:45:22 user nova-compute[73110]:     </interface>
Aug 26 17:45:22 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:45:22 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/console.log" append="off"/>
Aug 26 17:45:22 user nova-compute[73110]:     </serial>
Aug 26 17:45:22 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:45:22 user nova-compute[73110]:     <video>
Aug 26 17:45:22 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:22 user nova-compute[73110]:     </video>
Aug 26 17:45:22 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:45:22 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:45:22 user nova-compute[73110]:     </rng>
Aug 26 17:45:22 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:45:22 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:45:22 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:45:22 user nova-compute[73110]:     </memballoon>
Aug 26 17:45:22 user nova-compute[73110]:   </devices>
Aug 26 17:45:22 user nova-compute[73110]: </domain>
Aug 26 17:45:22 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiQhqTDtKrFX1L/2k2BPbeFPcIx9Dqv0wygQtrma1XCnxRE2QRpxl/L3gRfi7ZNWt9BNE+kb42vyxBj9a2nDWN8/Og4gyoZy2aQUo+1M1nags1woJmceUS+SEb9dtSGPA==',key_name='tempest-keypair-1356496581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG os_vif [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap022f585c-5c, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap022f585c-5c, col_values=(('external_ids', {'iface-id': '022f585c-5ca8-414c-b0cd-59c98b2f1254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:62:e1', 'vm-uuid': 'e277fb69-1fba-42da-98f6-7b55b892788e'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:22 user nova-compute[73110]: INFO os_vif [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c')
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No VIF found with MAC fa:16:3e:9c:62:e1, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updated VIF entry in instance network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0dd76f2-2249-4e52-a3d0-a68baa11815a req-ff7acb2b-7e6b-4b4c-be7c-543a77a0dba9 service nova] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:24 user nova-compute[73110]: WARNING nova.compute.manager [req-970a9d1c-eb70-4853-ba16-cfd13ab2fa9c req-959836b5-b418-409e-b794-bc9e003a28c2 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state building and task_state spawning.
Aug 26 17:45:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.claims [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Claim successful on node user
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071926.3000245, e277fb69-1fba-42da-98f6-7b55b892788e => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Resumed (Lifecycle Event)
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:26 user nova-compute[73110]: WARNING nova.compute.manager [req-da1c5233-7893-41c2-9343-bf7887a9388c req-55b3ba77-62c4-473d-a9c7-171147304076 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state building and task_state spawning.
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance spawned successfully.
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071926.3052955, e277fb69-1fba-42da-98f6-7b55b892788e => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Started (Lifecycle Event)
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.compute.manager [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Took 7.89 seconds to build instance.
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7612ede9-2390-4242-b499-2714912da86e tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.026s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:45:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:45:26 user nova-compute[73110]: DEBUG nova.policy [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b760f93150047f2b46656642fe57efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9df13541045f0b8baace5322a08c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:45:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Creating image(s)
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "/opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk 1073741824" returned: 0 in 0.060s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Successfully created port: 45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Cannot resize image /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Ensure instance console log exists: /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Successfully updated port: 45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquired lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-changed-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Refreshing instance network info cache due to event network-changed-45be2928-8345-4117-ad38-e992f43ebb8a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] Acquiring lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating instance_info_cache with network_info: [{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Releasing lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Instance network_info: |[{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] Acquired lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Refreshing network info cache for port 45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Start _get_guest_xml network_info=[{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:45:29 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:29 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2024350329',display_name='tempest-AttachVolumeNegativeTest-server-2024350329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2024350329',id=16,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzRLGJa/XrjAmRxV6V1tTxjsKhRJcoUtf9PSplbreirryjNvAsk0/i5weKvXiVvaLuZUJEt1k7nTLN+at4Qr0u5kSv4J+Cs9aIKAgog6JEVnZ9sNbn1zMdfC1H6K4hwYA==',key_name='tempest-keypair-963001878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-o1vtnvpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=23d907b6-f633-40a1-976f-ccd87e780cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'pci_devices' on Instance uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:45:29 user nova-compute[73110]:   <uuid>23d907b6-f633-40a1-976f-ccd87e780cf1</uuid>
Aug 26 17:45:29 user nova-compute[73110]:   <name>instance-00000010</name>
Aug 26 17:45:29 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:45:29 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:45:29 user nova-compute[73110]:   <metadata>
Aug 26 17:45:29 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:45:29 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2024350329</nova:name>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:45:29</nova:creationTime>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:45:29 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:45:29 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:owner>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:user uuid="3b760f93150047f2b46656642fe57efc">tempest-AttachVolumeNegativeTest-650369-project-member</nova:user>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:project uuid="d0d9df13541045f0b8baace5322a08c4">tempest-AttachVolumeNegativeTest-650369</nova:project>
Aug 26 17:45:29 user nova-compute[73110]:       </nova:owner>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:45:29 user nova-compute[73110]:       <nova:ports>
Aug 26 17:45:29 user nova-compute[73110]:         <nova:port uuid="45be2928-8345-4117-ad38-e992f43ebb8a">
Aug 26 17:45:29 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 17:45:29 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:29 user nova-compute[73110]:       </nova:ports>
Aug 26 17:45:29 user nova-compute[73110]:     </nova:instance>
Aug 26 17:45:29 user nova-compute[73110]:   </metadata>
Aug 26 17:45:29 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:45:29 user nova-compute[73110]:     <system>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="serial">23d907b6-f633-40a1-976f-ccd87e780cf1</entry>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="uuid">23d907b6-f633-40a1-976f-ccd87e780cf1</entry>
Aug 26 17:45:29 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:45:29 user nova-compute[73110]:     </system>
Aug 26 17:45:29 user nova-compute[73110]:   </sysinfo>
Aug 26 17:45:29 user nova-compute[73110]:   <os>
Aug 26 17:45:29 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:45:29 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:45:29 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:45:29 user nova-compute[73110]:   </os>
Aug 26 17:45:29 user nova-compute[73110]:   <features>
Aug 26 17:45:29 user nova-compute[73110]:     <acpi/>
Aug 26 17:45:29 user nova-compute[73110]:     <apic/>
Aug 26 17:45:29 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:45:29 user nova-compute[73110]:   </features>
Aug 26 17:45:29 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:45:29 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:45:29 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:45:29 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:45:29 user nova-compute[73110]:   </clock>
Aug 26 17:45:29 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:45:29 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:45:29 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:45:29 user nova-compute[73110]:   </cpu>
Aug 26 17:45:29 user nova-compute[73110]:   <devices>
Aug 26 17:45:29 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:45:29 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:45:29 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk"/>
Aug 26 17:45:29 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:45:29 user nova-compute[73110]:     </disk>
Aug 26 17:45:29 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:29 user nova-compute[73110]:       <mac address="fa:16:3e:7d:09:ed"/>
Aug 26 17:45:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:29 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:29 user nova-compute[73110]:       <target dev="tap45be2928-83"/>
Aug 26 17:45:29 user nova-compute[73110]:     </interface>
Aug 26 17:45:29 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:45:29 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/console.log" append="off"/>
Aug 26 17:45:29 user nova-compute[73110]:     </serial>
Aug 26 17:45:29 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:45:29 user nova-compute[73110]:     <video>
Aug 26 17:45:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:29 user nova-compute[73110]:     </video>
Aug 26 17:45:29 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:45:29 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:45:29 user nova-compute[73110]:     </rng>
Aug 26 17:45:29 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:45:29 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:45:29 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:45:29 user nova-compute[73110]:     </memballoon>
Aug 26 17:45:29 user nova-compute[73110]:   </devices>
Aug 26 17:45:29 user nova-compute[73110]: </domain>
Aug 26 17:45:29 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2024350329',display_name='tempest-AttachVolumeNegativeTest-server-2024350329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2024350329',id=16,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzRLGJa/XrjAmRxV6V1tTxjsKhRJcoUtf9PSplbreirryjNvAsk0/i5weKvXiVvaLuZUJEt1k7nTLN+at4Qr0u5kSv4J+Cs9aIKAgog6JEVnZ9sNbn1zMdfC1H6K4hwYA==',key_name='tempest-keypair-963001878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-o1vtnvpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=23d907b6-f633-40a1-976f-ccd87e780cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG os_vif [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45be2928-83, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45be2928-83, col_values=(('external_ids', {'iface-id': '45be2928-8345-4117-ad38-e992f43ebb8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:09:ed', 'vm-uuid': '23d907b6-f633-40a1-976f-ccd87e780cf1'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:29 user nova-compute[73110]: INFO os_vif [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83')
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:45:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:7d:09:ed, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:45:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updated VIF entry in instance network info cache for port 45be2928-8345-4117-ad38-e992f43ebb8a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:45:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating instance_info_cache with network_info: [{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b61d434e-f139-419f-853d-790e9e869b1e req-fd0e94a9-ff7f-4705-8961-0cff955b6e85 service nova] Releasing lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] No waiting events found dispatching network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:31 user nova-compute[73110]: WARNING nova.compute.manager [req-411bc441-9da6-486a-a732-92bc5a7cddf0 req-c4233661-912b-421b-aa19-795eff9a78d9 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received unexpected event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a for instance with vm_state building and task_state spawning.
Aug 26 17:45:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] No waiting events found dispatching network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:33 user nova-compute[73110]: WARNING nova.compute.manager [req-7c88ed8b-ffdb-4739-b8a4-faaa8b14f82e req-65c71651-2327-40b3-a641-f64a8613799b service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received unexpected event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a for instance with vm_state building and task_state spawning.
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071934.0797653, 23d907b6-f633-40a1-976f-ccd87e780cf1 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] VM Resumed (Lifecycle Event)
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Instance spawned successfully.
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071934.0818193, 23d907b6-f633-40a1-976f-ccd87e780cf1 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] VM Started (Lifecycle Event)
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 26 17:45:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:45:34 user nova-compute[73110]: INFO nova.compute.manager [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Took 8.36 seconds to build instance.
Aug 26 17:45:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a3cf1be5-6cfd-4d41-908d-d5a0fcf27b00 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.529s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:36 user nova-compute[73110]: INFO nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Booting with volume 86d87afb-8c1f-4c27-82ef-2357f3b59417 at /dev/vdc
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990d35a-95f3-4ce1-bef6-8f5b688c20c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[920133f9-dec6-48d3-b2ca-d755f9cc843a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e2cf0b-e912-44f0-81ec-dd675fe93385]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea4af3-38c4-4470-b708-5ab991a144d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:36 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:45:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e786b9f-737a-42bc-91b1-071adab64a34]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG os_brick.utils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:36 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating existing volume attachment record: 14f4fcfe-a4d5-4a1e-8a07-7b4aceb7a43d {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:45:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-changed-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Refreshing instance network info cache due to event network-changed-a045650c-7390-47e9-9a99-586c63fcd273. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] Acquiring lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] Acquired lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG nova.network.neutron [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Refreshing network info cache for port a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:45:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updated VIF entry in instance network info cache for port a045650c-7390-47e9-9a99-586c63fcd273. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating instance_info_cache with network_info: [{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82a9d658-b183-4c83-8332-e47c86009ec4 req-d99360d6-59b1-4cac-95bd-2e215d1213fd service nova] Releasing lock "refresh_cache-8662b876-8ed7-4b01-b28a-ce551b8d0097" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG nova.objects.instance [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'flavor' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:40 user nova-compute[73110]: INFO nova.compute.manager [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attaching volume cb2518f8-4972-432e-82ef-333bf17b9db0 to /dev/vdb
Aug 26 17:45:40 user nova-compute[73110]: DEBUG os_brick.utils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0b9ee0-4819-4685-93a8-e2917b94fe17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7af4b1-b45a-4c87-b465-e49174249432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b4b08-c3dc-4e11-9485-a4570c7185c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f3789-fa4f-491d-9dc0-ac7887014a46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:45:41 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:45:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36f1b1-0ebc-47f6-94ff-b6307fb6ab8f]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG os_brick.utils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:41 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating existing volume attachment record: c230afbe-75d7-4d6c-851c-cea155768d81 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:45:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:44 user nova-compute[73110]: INFO nova.compute.manager [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Terminating instance
Aug 26 17:45:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-unplugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] No waiting events found dispatching network-vif-unplugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-1bdc5d50-3f35-4f17-b09e-5de084928c98 req-b7a6aeec-5133-4eac-a1f2-78517f32d0f8 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-unplugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Instance destroyed successfully.
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'resources' on Instance uuid 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980581169',display_name='tempest-VolumesAdminNegativeTest-server-1980581169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980581169',id=12,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:43:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-0fgjrwpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:43:46Z,user_data=None,user_id='07467ef74ea34f21949b8a00da319315',uuid=68d61f94-0fcb-4a6f-85e0-d441ab789aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "address": "fa:16:3e:b3:19:43", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd01dda-0f", "ovs_interfaceid": "9cd01dda-0f42-449b-a0d7-d8bba46dfad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG os_vif [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cd01dda-0f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:45 user nova-compute[73110]: INFO os_vif [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:19:43,bridge_name='br-int',has_traffic_filtering=True,id=9cd01dda-0f42-449b-a0d7-d8bba46dfad7,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd01dda-0f')
Aug 26 17:45:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Deleting instance files /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1_del
Aug 26 17:45:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Deletion of /opt/stack/data/nova/instances/68d61f94-0fcb-4a6f-85e0-d441ab789aa1_del complete
Aug 26 17:45:45 user nova-compute[73110]: INFO nova.compute.manager [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 17:45:45 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:45:45 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:46 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Took 0.71 seconds to deallocate network for instance.
Aug 26 17:45:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-ee85a312-baa1-40c6-aab5-13028e90b273 req-5132ad46-70a3-4c09-b02f-87f600f9640a service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-deleted-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:46 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Deleted allocations for instance 68d61f94-0fcb-4a6f-85e0-d441ab789aa1
Aug 26 17:45:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c131b5c-2702-4d6c-8efd-82352aad5dde tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] Acquiring lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] Lock "68d61f94-0fcb-4a6f-85e0-d441ab789aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] No waiting events found dispatching network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:47 user nova-compute[73110]: WARNING nova.compute.manager [req-e9ef518f-fe63-4cff-88c5-6b31f8764394 req-924023c4-d1cd-4b0e-a242-42e28fc653a5 service nova] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Received unexpected event network-vif-plugged-9cd01dda-0f42-449b-a0d7-d8bba46dfad7 for instance with vm_state deleted and task_state None.
Aug 26 17:45:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 17:45:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:45:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Creating image(s)
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Ensure instance console log exists: /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Start _get_guest_xml network_info=[{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f41a92a8-9e49-4fe8-a84c-13a5a1d09dbd', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtVxrGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '253d1925-ec97-480f-b99b-68942d327b69', 'attached_at': '', 'detached_at': '', 'volume_id': '640e900b-27b9-409c-b9a3-889be0768f9a', 'serial': '640e900b-27b9-409c-b9a3-889be0768f9a'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'c86de8a6-bfa7-4a83-9704-bd3cdd871891', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEzKjuxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '253d1925-ec97-480f-b99b-68942d327b69', 'attached_at': '', 'detached_at': '', 'volume_id': 'e141ab67-8feb-43d2-8976-4954fc9bf1e2', 'serial': 'e141ab67-8feb-43d2-8976-4954fc9bf1e2'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '14f4fcfe-a4d5-4a1e-8a07-7b4aceb7a43d', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruiansLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '253d1925-ec97-480f-b99b-68942d327b69', 'attached_at': '', 'detached_at': '', 'volume_id': '86d87afb-8c1f-4c27-82ef-2357f3b59417', 'serial': '86d87afb-8c1f-4c27-82ef-2357f3b59417'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:45:50 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:50 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtVxrGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:50 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:50 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:50 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0460ad-e95f-4f7b-a2da-109e4785ecc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:45:50 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[216f19df-801c-4b88-a1cb-b2f792cf8425]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a] added
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5619c82-91c9-4123-bf4f-95920f93a7c0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b52e6-7f7e-443c-b4ba-ddf4537ddf89]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTtVxrGh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTtVxrGh" returned: 0 in 0.064s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bbe199-48c6-45a4-9bc9-ac8ba49311b5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTtVxrGh'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f17af0-e35f-4045-abf8-821dd6db122b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ae2b3-395c-45dc-a153-7d83579acf7a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b29a442-aa75-4143-abc8-4789c04db2ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260]
Aug 26 17:45:50 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260] successful.
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9a1ed4-6a5a-4715-81b9-5db31e180b3e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e75047-8cce-4d98-b546-f3270e724388]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:50 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:50 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:45:50 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0415a2aa-1286-49cc-940a-d590a0ac050c]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:51 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:45:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtVxrGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26234656365356533', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234656365356533', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEzKjuxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:52 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:52 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:52 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f4c05-e71e-441d-a650-a8488d8fa822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:45:52 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb3cc7-0d87-40c3-8ad0-39eb6c05bbcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2] added
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b1ce6-f5b9-47c8-9cc7-111e165f1073]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef325e5a-48ba-42b9-864f-7fa33db0bb1d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEzKjuxo {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEzKjuxo" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b511bf7c-6f8f-4fd6-a6bd-6d34d6cc1557]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SEzKjuxo'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[269fc5c5-64f8-464f-bd0b-a4520ac3ea99]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997eb91-76a2-410d-b579-224f599682c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[00080a43-ccd9-46bf-9767-ec7f021fc616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260]
Aug 26 17:45:52 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260] successful.
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221e4f4-ba95-4407-ae4a-4941767073f2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f91e3-6362-4b97-b856-f1a9db35b5da]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:52 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6723ed-52c9-47d1-953c-723674a6c46f]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:45:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEzKjuxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23830663033303263', 'path': '/dev/sdf'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830663033303263', 'path': '/dev/sdf'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruiansLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:45:53 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:53 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:45:53 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8162be41-8a16-4b30-b6b4-53af03ac183e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:45:53 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b907b8a-57b6-4d4e-9562-8b76e5827aa8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417] added
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e489b6d-cdaf-4a10-aa69-edcf9d90c0e0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6380f-6ed4-41a8-9c85-270e73a87118]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruiansLY {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruiansLY" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a7285-6359-4da2-8b3f-fc037417d056]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruiansLY'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91fceae-4e9c-4950-9a57-596c7aae5074]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b0e87-f39d-4ea6-b694-b13be8bae065]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eafc7f-b359-4d5b-a59e-58e4b0652132]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260]
Aug 26 17:45:53 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260] successful.
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef609f3a-28bf-4801-8a88-4c27b67b1c00]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d6eb6c-2d2e-4abd-9688-f0232be87acb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:45:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ebd64-4287-4f34-a922-91f0981efa4e]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:45:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruiansLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23638326536383031', 'path': '/dev/sdg'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638326536383031', 'path': '/dev/sdg'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.objects.instance [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lazy-loading 'pci_devices' on Instance uuid 253d1925-ec97-480f-b99b-68942d327b69 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:45:54 user nova-compute[73110]:   <uuid>253d1925-ec97-480f-b99b-68942d327b69</uuid>
Aug 26 17:45:54 user nova-compute[73110]:   <name>instance-0000000e</name>
Aug 26 17:45:54 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:45:54 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:45:54 user nova-compute[73110]:   <metadata>
Aug 26 17:45:54 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:45:54 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:name>tempest-device-tagging-server-1942812038</nova:name>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:45:50</nova:creationTime>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:45:54 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:45:54 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:owner>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:user uuid="41b4e420b9054bc7ba61d6650aa255b4">tempest-TaggedBootDevicesTest-1744838706-project-member</nova:user>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:project uuid="94497159fb204730a1e1caa4cbd1c4ee">tempest-TaggedBootDevicesTest-1744838706</nova:project>
Aug 26 17:45:54 user nova-compute[73110]:       </nova:owner>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:45:54 user nova-compute[73110]:       <nova:ports>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="bdf99d67-c2bc-48b8-a630-e41da0f43ae1">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="832ca559-80a3-4851-ae44-a800f04ed67f">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="2ee5d5cb-a2d2-467e-b649-41b68830a249">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="130ca0c1-6df7-489b-b320-806099d3c26b">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="a43208c1-62da-4efa-b040-4f7e47e8b34a">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="737d387c-f6ef-456b-9e6d-9bc2819bdf98">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:         <nova:port uuid="e667c685-08c3-4b5d-882b-c1cddecb161e">
Aug 26 17:45:54 user nova-compute[73110]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 17:45:54 user nova-compute[73110]:         </nova:port>
Aug 26 17:45:54 user nova-compute[73110]:       </nova:ports>
Aug 26 17:45:54 user nova-compute[73110]:     </nova:instance>
Aug 26 17:45:54 user nova-compute[73110]:   </metadata>
Aug 26 17:45:54 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:45:54 user nova-compute[73110]:     <system>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="serial">253d1925-ec97-480f-b99b-68942d327b69</entry>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="uuid">253d1925-ec97-480f-b99b-68942d327b69</entry>
Aug 26 17:45:54 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:45:54 user nova-compute[73110]:     </system>
Aug 26 17:45:54 user nova-compute[73110]:   </sysinfo>
Aug 26 17:45:54 user nova-compute[73110]:   <os>
Aug 26 17:45:54 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:45:54 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:45:54 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:45:54 user nova-compute[73110]:   </os>
Aug 26 17:45:54 user nova-compute[73110]:   <features>
Aug 26 17:45:54 user nova-compute[73110]:     <acpi/>
Aug 26 17:45:54 user nova-compute[73110]:     <apic/>
Aug 26 17:45:54 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:45:54 user nova-compute[73110]:   </features>
Aug 26 17:45:54 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:45:54 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:45:54 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:45:54 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:45:54 user nova-compute[73110]:   </clock>
Aug 26 17:45:54 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:45:54 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:45:54 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:45:54 user nova-compute[73110]:   </cpu>
Aug 26 17:45:54 user nova-compute[73110]:   <devices>
Aug 26 17:45:54 user nova-compute[73110]:     <disk type="file" device="cdrom">
Aug 26 17:45:54 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 17:45:54 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/disk.config"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="hda" bus="ide"/>
Aug 26 17:45:54 user nova-compute[73110]:     </disk>
Aug 26 17:45:54 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:45:54 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:45:54 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <serial>640e900b-27b9-409c-b9a3-889be0768f9a</serial>
Aug 26 17:45:54 user nova-compute[73110]:     </disk>
Aug 26 17:45:54 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:45:54 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:45:54 user nova-compute[73110]:       <source dev="/dev/sdf"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <serial>e141ab67-8feb-43d2-8976-4954fc9bf1e2</serial>
Aug 26 17:45:54 user nova-compute[73110]:     </disk>
Aug 26 17:45:54 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:45:54 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:45:54 user nova-compute[73110]:       <source dev="/dev/sdg"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="vdc" bus="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <serial>86d87afb-8c1f-4c27-82ef-2357f3b59417</serial>
Aug 26 17:45:54 user nova-compute[73110]:     </disk>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:96:99:22"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tapbdf99d67-c2"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:6e:97:aa"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tap832ca559-80"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:bc:5d:1f"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tap2ee5d5cb-a2"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:93:b7:cf"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tap130ca0c1-6d"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:ed:d7:4c"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tapa43208c1-62"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:d9:7f:b0"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tap737d387c-f6"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:45:54 user nova-compute[73110]:       <mac address="fa:16:3e:a4:be:48"/>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:45:54 user nova-compute[73110]:       <target dev="tape667c685-08"/>
Aug 26 17:45:54 user nova-compute[73110]:     </interface>
Aug 26 17:45:54 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:45:54 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/console.log" append="off"/>
Aug 26 17:45:54 user nova-compute[73110]:     </serial>
Aug 26 17:45:54 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:45:54 user nova-compute[73110]:     <video>
Aug 26 17:45:54 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:45:54 user nova-compute[73110]:     </video>
Aug 26 17:45:54 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:45:54 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:45:54 user nova-compute[73110]:     </rng>
Aug 26 17:45:54 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:45:54 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:45:54 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:45:54 user nova-compute[73110]:     </memballoon>
Aug 26 17:45:54 user nova-compute[73110]:   </devices>
Aug 26 17:45:54 user nova-compute[73110]: </domain>
Aug 26 17:45:54 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdf99d67-c2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdf99d67-c2, col_values=(('external_ids', {'iface-id': 'bdf99d67-c2bc-48b8-a630-e41da0f43ae1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:99:22', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2')
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap832ca559-80, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap832ca559-80, col_values=(('external_ids', {'iface-id': '832ca559-80a3-4851-ae44-a800f04ed67f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:97:aa', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee5d5cb-a2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ee5d5cb-a2, col_values=(('external_ids', {'iface-id': '2ee5d5cb-a2d2-467e-b649-41b68830a249', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:5d:1f', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap130ca0c1-6d, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap130ca0c1-6d, col_values=(('external_ids', {'iface-id': '130ca0c1-6df7-489b-b320-806099d3c26b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:b7:cf', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa43208c1-62, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa43208c1-62, col_values=(('external_ids', {'iface-id': 'a43208c1-62da-4efa-b040-4f7e47e8b34a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:d7:4c', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap737d387c-f6, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap737d387c-f6, col_values=(('external_ids', {'iface-id': '737d387c-f6ef-456b-9e6d-9bc2819bdf98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:7f:b0', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape667c685-08, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape667c685-08, col_values=(('external_ids', {'iface-id': 'e667c685-08c3-4b5d-882b-c1cddecb161e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:be:48', 'vm-uuid': '253d1925-ec97-480f-b99b-68942d327b69'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:55 user nova-compute[73110]: INFO os_vif [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08')
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] No BDM found with device name hda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] No VIF found with MAC fa:16:3e:96:99:22, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] No VIF found with MAC fa:16:3e:ed:d7:4c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:45:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Using config drive
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating instance_info_cache with network_info: [{"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:45:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Creating config drive at /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/disk.config
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxs4m72s9 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxs4m72s9" returned: 0 in 0.057s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:57 user nova-compute[73110]: WARNING nova.compute.manager [req-5efbf96e-15fa-4f91-9e7c-ea71667ffdf7 req-7146a2ca-9487-45a4-bc61-aaf105d27fb6 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 for instance with vm_state building and task_state spawning.
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:45:58 user nova-compute[73110]: WARNING nova.compute.manager [req-0083dc67-29e2-4eab-947e-b2f232a03380 req-0aac5099-5d67-4930-b392-bd20034016dc service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 for instance with vm_state building and task_state spawning.
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:45:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071962.0085402, 253d1925-ec97-480f-b99b-68942d327b69 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] VM Resumed (Lifecycle Event)
Aug 26 17:46:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071945.3247416, 68d61f94-0fcb-4a6f-85e0-d441ab789aa1 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] VM Stopped (Lifecycle Event)
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-7e9a7367-5b45-430f-96a6-88edf932f191 req-6034b2bb-161f-4d4a-82e6-46e9a175de62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-c8305e01-df75-4511-961a-60c2df5b5318 req-e8a5a681-ee1d-4b39-85ab-da5e47c31ff5 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-3b74e06c-592d-4c2f-950f-5571fc51533a req-27165c23-6a91-49b4-a374-efe6c348657d service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7be0c9ea-8844-4f69-a05d-81a12a8564ae None None] [instance: 68d61f94-0fcb-4a6f-85e0-d441ab789aa1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance spawned successfully.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=25.409534454345703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071962.009638, 253d1925-ec97-480f-b99b-68942d327b69 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] VM Started (Lifecycle Event)
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Applying migration context for instance 84d42b86-03a9-496c-85bd-e643ea8ab023 as it has an incoming, in-progress migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12. Migration status is finished {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating resource usage from migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-ec6caf36-9ba0-47e0-816f-f6008565a6f8 req-cc1d7b4a-8ba2-4cdb-a586-2bb158f31330 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 for instance with vm_state building and task_state spawning.
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Took 12.12 seconds to spawn the instance on the hypervisor.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:02 user nova-compute[73110]: INFO nova.compute.manager [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Took 65.76 seconds to build instance.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-881b55f6-290a-4459-acab-9c2afbff4758 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 65.896s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 253d1925-ec97-480f-b99b-68942d327b69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e277fb69-1fba-42da-98f6-7b55b892788e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a for instance with vm_state active and task_state None.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e for instance with vm_state active and task_state None.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:02 user nova-compute[73110]: WARNING nova.compute.manager [req-268c7f96-614c-4539-995a-6d2cc30c1eb7 req-132631f7-1454-441e-a781-ed07ae79c789 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e for instance with vm_state active and task_state None.
Aug 26 17:46:02 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.011s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:04 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:04 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:04 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11adb87-5d98-4582-9dbf-862fa780339d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:46:04 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0547f0d-0b22-471a-92db-3603c9ed2fe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0] added
Aug 26 17:46:04 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc54a476-6b00-4e06-879c-cf850ebebce4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3d4b4-11ba-42fa-8401-e2c540ae50e1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TemvPLUC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TemvPLUC" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf6af0-183f-4c50-aa8b-a164f9709c8a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TemvPLUC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e83cb0a-75e8-4342-9d0e-f8c43a6e8a81]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e08f5e-9925-4ec6-9fe2-8b952195c22a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e517d9-35b2-43c2-bda6-058a6fc27ce5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]
Aug 26 17:46:05 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab6c86-5978-4bd1-bb9b-edd1d1170d6e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891fe88-409a-4203-ab26-b691158e4885]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9085fd-731f-4339-99de-48e58b1d635e]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:46:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23434353463373937', 'path': '/dev/sdh'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353463373937', 'path': '/dev/sdh'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.objects.instance [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'flavor' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:46:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:06 user nova-compute[73110]:   <source dev="/dev/sdh"/>
Aug 26 17:46:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:06 user nova-compute[73110]:   <serial>cb2518f8-4972-432e-82ef-333bf17b9db0</serial>
Aug 26 17:46:06 user nova-compute[73110]: </disk>
Aug 26 17:46:06 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:06 user nova-compute[73110]: INFO nova.compute.manager [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Detaching volume 0de89c12-2d48-4021-9fac-fa17cf1aacc1
Aug 26 17:46:06 user nova-compute[73110]: INFO nova.virt.block_device [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Attempting to driver detach volume 0de89c12-2d48-4021-9fac-fa17cf1aacc1 from mountpoint /dev/vdb
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Attempting to detach device vdb from instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:46:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:06 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:46:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:06 user nova-compute[73110]:   <serial>0de89c12-2d48-4021-9fac-fa17cf1aacc1</serial>
Aug 26 17:46:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:46:06 user nova-compute[73110]: </disk>
Aug 26 17:46:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:46:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdb from instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 from the persistent domain config.
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:46:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:06 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:46:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:06 user nova-compute[73110]:   <serial>0de89c12-2d48-4021-9fac-fa17cf1aacc1</serial>
Aug 26 17:46:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:46:06 user nova-compute[73110]: </disk>
Aug 26 17:46:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:98:9c:ee, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:46:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9fd637ca-c6b6-4e4f-8829-a07783a3d61a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.113s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693071967.0507836, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:46:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdb from instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 from the live domain config.
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMdjevIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:07 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8343b3-fc3b-4965-a890-33defb944c12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a626d17-4357-46e1-b3ce-b4dc4abc4a08]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441ab2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86f8c9-3aca-4f97-9491-2c16b49865bf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:46:07 user nova-compute[73110]: INFO nova.compute.claims [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Claim successful on node user
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7409d8ac-3f41-4396-834f-7963bbbba714]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[54183d59-6557-456b-9cc0-6d2607236f7f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7de83-5c3a-44d6-8731-63292b5e8868]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba8c33-dbd0-45cc-9e65-a0cd90f6d247]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881f00b-d372-42d3-97f5-a209e42b6946]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260]
Aug 26 17:46:07 user nova-compute[73110]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de89c12-2d48-4021-9fac-fa17cf1aacc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea3d6ea-c78f-46c2-b14d-b42153e989d7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== disconnect_volume: return (425ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:46:07 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:46:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.policy [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f2fbfd19ab04e91a44dd5a1954f231d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a97610a2dc4c1c97890c6645883757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:46:08 user nova-compute[73110]: INFO nova.virt.block_device [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Booting with volume 53116ae7-3d6c-447d-9016-36fef4bab6d8 at /dev/vda
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd01e6c-13b4-4473-bbea-764312764bb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[10052114-6082-4bcf-806c-ee542305adcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3436c-f620-474c-bbfa-91aa2709e44c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3ef0b1-cd7d-48f2-9397-bef4f7cd6cfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:08 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4506daf4-46d8-450a-855b-e821f38af4a1]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating existing volume attachment record: 5e8ea188-8168-4b12-b1ce-b867be24f089 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.objects.instance [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-9c514c19-b625-443c-a1be-fa3050855e0c tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.243s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73110) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: INFO nova.compute.manager [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Rebuilding instance
Aug 26 17:46:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:09 user nova-compute[73110]: WARNING nova.compute.manager [req-b0cef0cd-7d45-4276-9fcc-5c0444c595a1 req-490fa967-a0ba-4fbc-a918-b9977dcb153b service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state powering-off.
Aug 26 17:46:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Successfully created port: d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:46:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance destroyed successfully.
Aug 26 17:46:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7f039965-fe39-4bce-b6d0-8a138e2e497d tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.179s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:10 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance destroyed successfully.
Aug 26 17:46:10 user nova-compute[73110]: INFO nova.compute.manager [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Detaching volume cb2518f8-4972-432e-82ef-333bf17b9db0
Aug 26 17:46:10 user nova-compute[73110]: INFO nova.virt.block_device [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attempting to driver detach volume cb2518f8-4972-432e-82ef-333bf17b9db0 from mountpoint /dev/vdb
Aug 26 17:46:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Attempting to detach device vdb from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:46:10 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:10 user nova-compute[73110]:   <source dev="/dev/sdh"/>
Aug 26 17:46:10 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:10 user nova-compute[73110]:   <serial>cb2518f8-4972-432e-82ef-333bf17b9db0</serial>
Aug 26 17:46:10 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:46:10 user nova-compute[73110]: </disk>
Aug 26 17:46:10 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:46:10 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully detached device vdb from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the persistent domain config.
Aug 26 17:46:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:10 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e5ced6-c049-4f93-b205-a1933642c846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b030d-75c0-4afe-820c-ef6c4481f47a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:10 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441d3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'): ({'sdh'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Removing single pathed devices sdh {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[552585bf-efdd-471b-a5a6-b8f7d617ff2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a71d4c-6203-46ab-959b-ac9c1cd4772f]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flushing IO for device /dev/sdh {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:46:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831b1b7-f985-4fd2-a47d-6a4badeb3f70]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Successfully updated port: d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquired lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6cf8a8-3267-4175-8237-b251a7d09372]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-changed-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Refreshing instance network info cache due to event network-changed-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] Acquiring lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d544042-1ad9-4903-bb8b-67c080d66428]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b40141-525c-4bc8-be13-070244b6489c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]
Aug 26 17:46:11 user nova-compute[73110]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5039a8b-5dc0-44d3-b2db-3c05d15b064e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== disconnect_volume: return (346ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:46:11 user nova-compute[73110]: INFO nova.compute.claims [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Claim successful on node user
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating instance_info_cache with network_info: [{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:11 user nova-compute[73110]: WARNING nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state stopped and task_state None.
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:11 user nova-compute[73110]: WARNING nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state rebuilding.
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:11 user nova-compute[73110]: WARNING nova.compute.manager [req-487a4bec-1e60-46c7-826b-438c989a95e2 req-bf82f268-e195-4799-b5e5-9c999f45194e service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state rebuilding.
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Releasing lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance network_info: |[{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] Acquired lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Refreshing network info cache for port d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:46:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:46:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updated VIF entry in instance network info cache for port d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating instance_info_cache with network_info: [{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.policy [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '477c0a3ee08e4e2995e29848c4063204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5a3c5972549491f8b0252e2cf81bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b9cb2669-93f0-4004-b257-86af228ff2c7 req-275976a3-21c7-497a-8c07-f23ec709b7b7 service nova] Releasing lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:46:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Creating image(s)
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "/opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "/opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance destroyed successfully.
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-ServerActionsTestOtherA-server-1112193447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa045650c-73, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:12 user nova-compute[73110]: INFO os_vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73')
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:12 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d00bc9b-60c9-47b4-835c-800c2f0191c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711aed4-6c89-4f5f-9b03-cb925df5e09c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:12 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e2add0>, {}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Disconnecting from: [] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== disconnect_volume: return (59ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:46:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Deleting instance files /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097_del
Aug 26 17:46:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Deletion of /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097_del complete
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk 1073741824" returned: 0 in 0.063s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: INFO nova.virt.block_device [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Booting with volume cb2518f8-4972-432e-82ef-333bf17b9db0 at /dev/vdb
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.utils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[859869a6-2523-446e-9cf9-47a4e66d90be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[716a619c-8eab-4f59-bc61-66163b49de26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f8322-c5a4-45c8-bdff-db5bf0387932]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a790b8a-5d03-4850-aaf0-6eac20b133ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Successfully created port: c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:12 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fcc7f-6fd2-4444-94a2-fd49aaaf4b5f]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG os_brick.utils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating existing volume attachment record: 4d442933-7046-42b4-923b-ae715963a65f {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Ensure instance console log exists: /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Successfully updated port: c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquired lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-changed-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Refreshing instance network info cache due to event network-changed-c39bb030-e58f-443b-ab28-53d9f1561f5f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] Acquiring lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:46:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Releasing lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Instance network_info: |[{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] Acquired lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Refreshing network info cache for port c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Start _get_guest_xml network_info=[{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:46:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-836853341',display_name='tempest-SnapshotDataIntegrityTests-server-836853341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-836853341',id=18,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Zj6hWNjV4LNWR9aWmnyOsTy1jhSZE7/LKHFZcs5EWg1ww+rraQLztLsJvQE4hE5Jz07+DfqWGifnP4Jw48BJiQUSPATyiK/ipam8amnmfO4nhfZuuHMWk7zVwuNw4Qw==',key_name='tempest-keypair-956042781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5a3c5972549491f8b0252e2cf81bf31',ramdisk_id='',reservation_id='r-s141jin4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-592165283',owner_user_name='tempest-SnapshotDataIntegrityTests-592165283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='477c0a3ee08e4e2995e29848c4063204',uuid=f7c61d60-b862-475f-84cd-bf03501890b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converting VIF {"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:46:14 user nova-compute[73110]:   <uuid>f7c61d60-b862-475f-84cd-bf03501890b0</uuid>
Aug 26 17:46:14 user nova-compute[73110]:   <name>instance-00000012</name>
Aug 26 17:46:14 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:46:14 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:46:14 user nova-compute[73110]:   <metadata>
Aug 26 17:46:14 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:46:14 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-836853341</nova:name>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:46:14</nova:creationTime>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:46:14 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:46:14 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:owner>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:user uuid="477c0a3ee08e4e2995e29848c4063204">tempest-SnapshotDataIntegrityTests-592165283-project-member</nova:user>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:project uuid="b5a3c5972549491f8b0252e2cf81bf31">tempest-SnapshotDataIntegrityTests-592165283</nova:project>
Aug 26 17:46:14 user nova-compute[73110]:       </nova:owner>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:46:14 user nova-compute[73110]:       <nova:ports>
Aug 26 17:46:14 user nova-compute[73110]:         <nova:port uuid="c39bb030-e58f-443b-ab28-53d9f1561f5f">
Aug 26 17:46:14 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:46:14 user nova-compute[73110]:         </nova:port>
Aug 26 17:46:14 user nova-compute[73110]:       </nova:ports>
Aug 26 17:46:14 user nova-compute[73110]:     </nova:instance>
Aug 26 17:46:14 user nova-compute[73110]:   </metadata>
Aug 26 17:46:14 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:46:14 user nova-compute[73110]:     <system>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="serial">f7c61d60-b862-475f-84cd-bf03501890b0</entry>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="uuid">f7c61d60-b862-475f-84cd-bf03501890b0</entry>
Aug 26 17:46:14 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:46:14 user nova-compute[73110]:     </system>
Aug 26 17:46:14 user nova-compute[73110]:   </sysinfo>
Aug 26 17:46:14 user nova-compute[73110]:   <os>
Aug 26 17:46:14 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:46:14 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:46:14 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:46:14 user nova-compute[73110]:   </os>
Aug 26 17:46:14 user nova-compute[73110]:   <features>
Aug 26 17:46:14 user nova-compute[73110]:     <acpi/>
Aug 26 17:46:14 user nova-compute[73110]:     <apic/>
Aug 26 17:46:14 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:46:14 user nova-compute[73110]:   </features>
Aug 26 17:46:14 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:46:14 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:46:14 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:46:14 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:46:14 user nova-compute[73110]:   </clock>
Aug 26 17:46:14 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:46:14 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:46:14 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:46:14 user nova-compute[73110]:   </cpu>
Aug 26 17:46:14 user nova-compute[73110]:   <devices>
Aug 26 17:46:14 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:46:14 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:46:14 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk"/>
Aug 26 17:46:14 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:46:14 user nova-compute[73110]:     </disk>
Aug 26 17:46:14 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:46:14 user nova-compute[73110]:       <mac address="fa:16:3e:19:82:35"/>
Aug 26 17:46:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:14 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:46:14 user nova-compute[73110]:       <target dev="tapc39bb030-e5"/>
Aug 26 17:46:14 user nova-compute[73110]:     </interface>
Aug 26 17:46:14 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:46:14 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/console.log" append="off"/>
Aug 26 17:46:14 user nova-compute[73110]:     </serial>
Aug 26 17:46:14 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:46:14 user nova-compute[73110]:     <video>
Aug 26 17:46:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:14 user nova-compute[73110]:     </video>
Aug 26 17:46:14 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:46:14 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:46:14 user nova-compute[73110]:     </rng>
Aug 26 17:46:14 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:46:14 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:46:14 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:46:14 user nova-compute[73110]:     </memballoon>
Aug 26 17:46:14 user nova-compute[73110]:   </devices>
Aug 26 17:46:14 user nova-compute[73110]: </domain>
Aug 26 17:46:14 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-836853341',display_name='tempest-SnapshotDataIntegrityTests-server-836853341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-836853341',id=18,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Zj6hWNjV4LNWR9aWmnyOsTy1jhSZE7/LKHFZcs5EWg1ww+rraQLztLsJvQE4hE5Jz07+DfqWGifnP4Jw48BJiQUSPATyiK/ipam8amnmfO4nhfZuuHMWk7zVwuNw4Qw==',key_name='tempest-keypair-956042781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5a3c5972549491f8b0252e2cf81bf31',ramdisk_id='',reservation_id='r-s141jin4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-592165283',owner_user_name='tempest-SnapshotDataIntegrityTests-592165283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='477c0a3ee08e4e2995e29848c4063204',uuid=f7c61d60-b862-475f-84cd-bf03501890b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converting VIF {"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG os_vif [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc39bb030-e5, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc39bb030-e5, col_values=(('external_ids', {'iface-id': 'c39bb030-e58f-443b-ab28-53d9f1561f5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:82:35', 'vm-uuid': 'f7c61d60-b862-475f-84cd-bf03501890b0'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:14 user nova-compute[73110]: INFO os_vif [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5')
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No VIF found with MAC fa:16:3e:19:82:35, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updated VIF entry in instance network info cache for port c39bb030-e58f-443b-ab28-53d9f1561f5f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ce3ed056-d9ee-4fa9-aa29-4814baf155e2 req-078db94d-f1cc-4d93-a002-4f829f55ea86 service nova] Releasing lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] No waiting events found dispatching network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:16 user nova-compute[73110]: WARNING nova.compute.manager [req-ee8d7c7f-592e-45a1-af32-9c88befe0d32 req-cdeb2aa1-536d-4194-9500-768a53162349 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received unexpected event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f for instance with vm_state building and task_state spawning.
Aug 26 17:46:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071977.9425502, f7c61d60-b862-475f-84cd-bf03501890b0 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] VM Resumed (Lifecycle Event)
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:46:17 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Instance spawned successfully.
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:17 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071977.9451635, f7c61d60-b862-475f-84cd-bf03501890b0 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] VM Started (Lifecycle Event)
Aug 26 17:46:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:18 user nova-compute[73110]: INFO nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 17:46:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:18 user nova-compute[73110]: INFO nova.compute.manager [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Took 6.88 seconds to build instance.
Aug 26 17:46:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-30075ea8-b793-4366-a767-b620d4bd73eb tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] No waiting events found dispatching network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:18 user nova-compute[73110]: WARNING nova.compute.manager [req-82fb8041-290e-42ee-b4d3-f65df676a71a req-e8602f07-055b-4587-8659-ed220264cf28 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received unexpected event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f for instance with vm_state active and task_state None.
Aug 26 17:46:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Port bc99d4df-9d70-45f8-ba11-6965e6f146dc binding to destination host user is already ACTIVE {{(pid=73110) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 17:46:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Creating tmpfile /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/tmpk9h2yi8l to verify with other compute node that the instance is on the same shared storage. {{(pid=73110) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:20 user nova-compute[73110]: INFO nova.compute.manager [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Unrescuing
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:20 user nova-compute[73110]: WARNING nova.compute.manager [req-d49c57f9-a6e0-4885-b622-8d02259461fd req-c3cd727f-e144-43dd-9076-1f613c31d9e2 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state resized and task_state resize_reverting.
Aug 26 17:46:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance destroyed successfully.
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'resources' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc99d4df-9d, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: INFO os_vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc62f7a-94b5-40a1-af42-46834753f9bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965e3fe-485c-4f43-8644-dfd7bfcfb129]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e2b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a956a-80d7-44f4-9993-a1828be77273]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[673cd7cd-0704-4415-aac0-a50a51739114]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef7ecc-fd21-41f8-a727-d17e6106b354]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f1ba5f-7a7b-4a5f-9543-7b67fcb5d803]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b094864-6db6-4f1a-8052-4d8ac405a515]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'flavor' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a270953a-8c14-49cc-8f55-9cdc17b402a0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:46:21 user nova-compute[73110]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f081e9-b864-48a7-ab5c-46afc679c9f3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== disconnect_volume: return (335ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:21 user nova-compute[73110]: WARNING nova.compute.manager [req-b59c1ac9-1ce8-4ccd-9bfe-31c9ee17a842 req-fe5ada52-46f3-4019-8d27-19e886cea07e service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:46:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance destroyed successfully.
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:46:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Creating image(s)
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Ensure instance console log exists: /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start _get_guest_xml network_info=[{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5e8ea188-8168-4b12-b1ce-b867be24f089', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2faed1ff-2bc7-4e0e-8034-4a893fd82871', 'attached_at': '', 'detached_at': '', 'volume_id': '53116ae7-3d6c-447d-9016-36fef4bab6d8', 'serial': '53116ae7-3d6c-447d-9016-36fef4bab6d8'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:46:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:22 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:22 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:22 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b07fbc6-8dd9-4535-b589-843799b64a17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:46:22 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3058718-24da-4490-be51-cc28b70b3e22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8] added
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d513ec1-316a-4119-9eb0-8577e8e6236c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fa892c-1ee7-4c69-95c9-d4272237f0c8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWLRhgrB {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWLRhgrB" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a425d708-5aef-47cd-8e95-04ae2db6c7d3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dWLRhgrB'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[52839873-ec52-4b3b-8566-9dfc987bd5fa]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeace97-d8be-42cf-85ab-c9ddd0aa6057]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb82697-7924-4d2d-97eb-04f5aa0136a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]
Aug 26 17:46:22 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:22 user nova-compute[73110]: WARNING nova.compute.manager [req-14f181ca-c63e-4883-a723-6aece99ae511 req-bd591c2b-3099-4057-96cc-d3f9a1bf3aa3 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state resized and task_state resize_reverting.
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[181cdac1-c856-4453-835b-2e36fc89e4d9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing instance network info cache due to event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f2c78-0784-4555-a566-1dfea131e0e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2248f5d9-64cd-4504-a082-d91baf58fcc8]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:46:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.network.neutron [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updated VIF entry in instance network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.network.neutron [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aa16b0b0-d054-4ea8-a203-f29911a88d40 req-2f9924c3-d899-4663-b973-a04b0baf6636 service nova] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26264613832353932', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264613832353932', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-728965317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lazy-loading 'pci_devices' on Instance uuid 2faed1ff-2bc7-4e0e-8034-4a893fd82871 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:24 user nova-compute[73110]: WARNING nova.compute.manager [req-11e869ea-9c9f-4684-9e22-5ae0bbd347c8 req-68464012-f84f-43a7-a39f-a770219edeba service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:46:24 user nova-compute[73110]:   <uuid>2faed1ff-2bc7-4e0e-8034-4a893fd82871</uuid>
Aug 26 17:46:24 user nova-compute[73110]:   <name>instance-00000011</name>
Aug 26 17:46:24 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:46:24 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:46:24 user nova-compute[73110]:   <metadata>
Aug 26 17:46:24 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:46:24 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:46:24 user nova-compute[73110]:       <nova:name>tempest-ServerActionsV293TestJSON-server-728965317</nova:name>
Aug 26 17:46:24 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:46:22</nova:creationTime>
Aug 26 17:46:24 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:46:24 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:46:24 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:46:24 user nova-compute[73110]:       <nova:owner>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:user uuid="5f2fbfd19ab04e91a44dd5a1954f231d">tempest-ServerActionsV293TestJSON-1105370441-project-member</nova:user>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:project uuid="c9a97610a2dc4c1c97890c6645883757">tempest-ServerActionsV293TestJSON-1105370441</nova:project>
Aug 26 17:46:24 user nova-compute[73110]:       </nova:owner>
Aug 26 17:46:24 user nova-compute[73110]:       <nova:ports>
Aug 26 17:46:24 user nova-compute[73110]:         <nova:port uuid="d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1">
Aug 26 17:46:24 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:46:24 user nova-compute[73110]:         </nova:port>
Aug 26 17:46:24 user nova-compute[73110]:       </nova:ports>
Aug 26 17:46:24 user nova-compute[73110]:     </nova:instance>
Aug 26 17:46:24 user nova-compute[73110]:   </metadata>
Aug 26 17:46:24 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:46:24 user nova-compute[73110]:     <system>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="serial">2faed1ff-2bc7-4e0e-8034-4a893fd82871</entry>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="uuid">2faed1ff-2bc7-4e0e-8034-4a893fd82871</entry>
Aug 26 17:46:24 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:46:24 user nova-compute[73110]:     </system>
Aug 26 17:46:24 user nova-compute[73110]:   </sysinfo>
Aug 26 17:46:24 user nova-compute[73110]:   <os>
Aug 26 17:46:24 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:46:24 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:46:24 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:46:24 user nova-compute[73110]:   </os>
Aug 26 17:46:24 user nova-compute[73110]:   <features>
Aug 26 17:46:24 user nova-compute[73110]:     <acpi/>
Aug 26 17:46:24 user nova-compute[73110]:     <apic/>
Aug 26 17:46:24 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:46:24 user nova-compute[73110]:   </features>
Aug 26 17:46:24 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:46:24 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:46:24 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:46:24 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:46:24 user nova-compute[73110]:   </clock>
Aug 26 17:46:24 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:46:24 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:46:24 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:46:24 user nova-compute[73110]:   </cpu>
Aug 26 17:46:24 user nova-compute[73110]:   <devices>
Aug 26 17:46:24 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:46:24 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:24 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:46:24 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:46:24 user nova-compute[73110]:       <serial>53116ae7-3d6c-447d-9016-36fef4bab6d8</serial>
Aug 26 17:46:24 user nova-compute[73110]:     </disk>
Aug 26 17:46:24 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:46:24 user nova-compute[73110]:       <mac address="fa:16:3e:eb:9b:41"/>
Aug 26 17:46:24 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:24 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:46:24 user nova-compute[73110]:       <target dev="tapd1dd4f93-8b"/>
Aug 26 17:46:24 user nova-compute[73110]:     </interface>
Aug 26 17:46:24 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:46:24 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871/console.log" append="off"/>
Aug 26 17:46:24 user nova-compute[73110]:     </serial>
Aug 26 17:46:24 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:46:24 user nova-compute[73110]:     <video>
Aug 26 17:46:24 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:24 user nova-compute[73110]:     </video>
Aug 26 17:46:24 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:46:24 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:46:24 user nova-compute[73110]:     </rng>
Aug 26 17:46:24 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:46:24 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:46:24 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:46:24 user nova-compute[73110]:     </memballoon>
Aug 26 17:46:24 user nova-compute[73110]:   </devices>
Aug 26 17:46:24 user nova-compute[73110]: </domain>
Aug 26 17:46:24 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-728965317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG os_vif [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1dd4f93-8b, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1dd4f93-8b, col_values=(('external_ids', {'iface-id': 'd1dd4f93-8bf7-474d-a10c-aa26b1c28ab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:9b:41', 'vm-uuid': '2faed1ff-2bc7-4e0e-8034-4a893fd82871'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: INFO os_vif [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b')
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] No VIF found with MAC fa:16:3e:eb:9b:41, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071969.8739536, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Stopped (Lifecycle Event)
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b4974174-1f1b-4ae8-8d58-914bd533f7dd None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b4974174-1f1b-4ae8-8d58-914bd533f7dd None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing instance network info cache due to event network-changed-215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] Acquiring lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] Acquired lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Refreshing network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG nova.network.neutron [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updated VIF entry in instance network info cache for port 215e0790-c265-4add-b5be-a21efa2c1bd4. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG nova.network.neutron [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [{"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e7b3fa77-d3d0-467d-bbd5-511f5b0bd59c req-285ff061-bb81-41a8-acee-f4db4118af44 service nova] Releasing lock "refresh_cache-2207fd05-7b0c-4b99-bad7-46c1707ec1bc" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071970.55659, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:25 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Stopped (Lifecycle Event)
Aug 26 17:46:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8c2c705c-4d3c-4972-b094-7cb8685eb69b None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:26 user nova-compute[73110]: WARNING nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:46:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:26 user nova-compute[73110]: WARNING nova.compute.manager [req-a698a865-b924-4a1c-af54-6b5e9f110814 req-047f9990-2f61-4703-9d66-41fa28425976 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:46:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:27 user nova-compute[73110]: WARNING nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state building and task_state spawning.
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:27 user nova-compute[73110]: WARNING nova.compute.manager [req-1f1a4503-2644-4e75-9062-792105ca6c93 req-a154c79e-ab13-430f-a45b-242521fdf2f2 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state building and task_state spawning.
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3ce16e8c-ea09-4ecb-9876-74e734f9a9ca tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 2207fd05-7b0c-4b99-bad7-46c1707ec1bc due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071987.3328905, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Resumed (Lifecycle Event)
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071987.3330147, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Started (Lifecycle Event)
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Creating image(s)
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'migration_context' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.objects.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Object Instance<84d42b86-03a9-496c-85bd-e643ea8ab023> lazy-loaded attributes: resources,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071987.8771732, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Resumed (Lifecycle Event)
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance spawned successfully.
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071987.8802512, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Started (Lifecycle Event)
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: INFO nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk 1073741824" returned: 0 in 0.073s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:28 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:46:28 user nova-compute[73110]: INFO nova.compute.manager [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Took 21.09 seconds to build instance.
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ac09cddc-0434-4d7b-a0de-8e16b78379c4 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.249s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.251s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.817s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Cannot resize image /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Ensure instance console log exists: /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start _get_guest_xml network_info=[{"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d442933-7046-42b4-923b-ae715963a65f', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8662b876-8ed7-4b01-b28a-ce551b8d0097', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb2518f8-4972-432e-82ef-333bf17b9db0', 'serial': 'cb2518f8-4972-432e-82ef-333bf17b9db0'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:46:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 17:46:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:28 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:28 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:28 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07e9d7-152b-4f75-aa38-4bd4ea6595fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:46:28 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: INFO nova.compute.manager [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Swapping old allocation on dict_keys(['166b0a1a-be79-4fde-8303-88dbbf28dbea']) held by migration e5e9d90b-c40f-44aa-90ee-0d1e53502b12 for instance
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[42656e25-1297-47cc-9fa4-253360cb5ac2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0] added
Aug 26 17:46:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e998c7-ce17-4418-ab75-0229f4fe75b4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Overwriting current allocation {'allocations': {'166b0a1a-be79-4fde-8303-88dbbf28dbea': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'aed9258ba923464ba423b3b9751f56cc', 'user_id': '72e7c15b85554d30915b4957791d2d54', 'consumer_generation': 1} on consumer 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17e56a-ff14-4fdd-a4b6-546c6b30db9a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TemvPLUC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TemvPLUC" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[76271f91-3125-439b-bd2f-923293478a53]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TemvPLUC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0820014e-02e4-48a5-a911-c6f16d847e72]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f78dc8-5579-4144-b427-508e7e4c14bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a359b-307d-4560-bcd8-a23d265ce26b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]
Aug 26 17:46:29 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0edbccf-f67a-452d-8b63-102e1e968b62]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec1be4-c27e-42e1-bb45-5251fed1395a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faece30-b8c0-4223-a99e-dbfcf4f57c2c]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.utils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12f5b9-3498-4b72-9694-ddda22256cda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d880b4-d8ca-45b7-83b8-5917f5c91ca6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdbdac-c8bf-445b-9c64-468b6932b187]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d09e2f5-fee2-4412-81f7-c4d4b011e95a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:46:29 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:46:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a32d303-9f4b-4898-b587-8c102939cdef]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:46:29 user nova-compute[73110]: DEBUG os_brick.utils [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23434353463373937', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353463373937', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-ServerActionsTestOtherA-server-1112193447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:46:30 user nova-compute[73110]:   <uuid>8662b876-8ed7-4b01-b28a-ce551b8d0097</uuid>
Aug 26 17:46:30 user nova-compute[73110]:   <name>instance-0000000d</name>
Aug 26 17:46:30 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:46:30 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:46:30 user nova-compute[73110]:   <metadata>
Aug 26 17:46:30 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:46:30 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherA-server-1112193447</nova:name>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:46:28</nova:creationTime>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:46:30 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:46:30 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:owner>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:user uuid="c351654543af4a9a86d72d041fcaacb4">tempest-ServerActionsTestOtherA-1020251450-project-member</nova:user>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:project uuid="8688c8465f324c4a9196980792b35718">tempest-ServerActionsTestOtherA-1020251450</nova:project>
Aug 26 17:46:30 user nova-compute[73110]:       </nova:owner>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:46:30 user nova-compute[73110]:       <nova:ports>
Aug 26 17:46:30 user nova-compute[73110]:         <nova:port uuid="a045650c-7390-47e9-9a99-586c63fcd273">
Aug 26 17:46:30 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:46:30 user nova-compute[73110]:         </nova:port>
Aug 26 17:46:30 user nova-compute[73110]:       </nova:ports>
Aug 26 17:46:30 user nova-compute[73110]:     </nova:instance>
Aug 26 17:46:30 user nova-compute[73110]:   </metadata>
Aug 26 17:46:30 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:46:30 user nova-compute[73110]:     <system>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="serial">8662b876-8ed7-4b01-b28a-ce551b8d0097</entry>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="uuid">8662b876-8ed7-4b01-b28a-ce551b8d0097</entry>
Aug 26 17:46:30 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:46:30 user nova-compute[73110]:     </system>
Aug 26 17:46:30 user nova-compute[73110]:   </sysinfo>
Aug 26 17:46:30 user nova-compute[73110]:   <os>
Aug 26 17:46:30 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:46:30 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:46:30 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:46:30 user nova-compute[73110]:   </os>
Aug 26 17:46:30 user nova-compute[73110]:   <features>
Aug 26 17:46:30 user nova-compute[73110]:     <acpi/>
Aug 26 17:46:30 user nova-compute[73110]:     <apic/>
Aug 26 17:46:30 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:46:30 user nova-compute[73110]:   </features>
Aug 26 17:46:30 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:46:30 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:46:30 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:46:30 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:46:30 user nova-compute[73110]:   </clock>
Aug 26 17:46:30 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:46:30 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:46:30 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:46:30 user nova-compute[73110]:   </cpu>
Aug 26 17:46:30 user nova-compute[73110]:   <devices>
Aug 26 17:46:30 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:46:30 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:46:30 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk"/>
Aug 26 17:46:30 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:46:30 user nova-compute[73110]:     </disk>
Aug 26 17:46:30 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:46:30 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:30 user nova-compute[73110]:       <source dev="/dev/sde"/>
Aug 26 17:46:30 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:46:30 user nova-compute[73110]:       <serial>cb2518f8-4972-432e-82ef-333bf17b9db0</serial>
Aug 26 17:46:30 user nova-compute[73110]:     </disk>
Aug 26 17:46:30 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:46:30 user nova-compute[73110]:       <mac address="fa:16:3e:98:9c:ee"/>
Aug 26 17:46:30 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:30 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:46:30 user nova-compute[73110]:       <target dev="tapa045650c-73"/>
Aug 26 17:46:30 user nova-compute[73110]:     </interface>
Aug 26 17:46:30 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:46:30 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/console.log" append="off"/>
Aug 26 17:46:30 user nova-compute[73110]:     </serial>
Aug 26 17:46:30 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:46:30 user nova-compute[73110]:     <video>
Aug 26 17:46:30 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:30 user nova-compute[73110]:     </video>
Aug 26 17:46:30 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:46:30 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:46:30 user nova-compute[73110]:     </rng>
Aug 26 17:46:30 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:46:30 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:46:30 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:46:30 user nova-compute[73110]:     </memballoon>
Aug 26 17:46:30 user nova-compute[73110]:   </devices>
Aug 26 17:46:30 user nova-compute[73110]: </domain>
Aug 26 17:46:30 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-ServerActionsTestOtherA-server-1112193447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG os_vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa045650c-73, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa045650c-73, col_values=(('external_ids', {'iface-id': 'a045650c-7390-47e9-9a99-586c63fcd273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9c:ee', 'vm-uuid': '8662b876-8ed7-4b01-b28a-ce551b8d0097'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:30 user nova-compute[73110]: INFO os_vif [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73')
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:46:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:98:9c:ee, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:46:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:32 user nova-compute[73110]: WARNING nova.compute.manager [req-3b9ef7e5-53d1-4a3b-aa8a-5f1d9fba149f req-57b129ab-c11c-4db3-9842-e43cc2c7c0f2 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 17:46:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:34 user nova-compute[73110]: WARNING nova.compute.manager [req-8e945c14-b0df-4bcb-b3df-ecff7c165360 req-5aaa5e1d-11b9-42b2-a064-6421e2192194 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071994.3821049, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Resumed (Lifecycle Event)
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:46:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance spawned successfully.
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:46:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693071994.3846946, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Started (Lifecycle Event)
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG nova.objects.instance [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73110) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 17:46:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-06db809c-7ba2-47a1-af02-8fb13dc318d3 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:36 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693071981.1842651, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:36 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Stopped (Lifecycle Event)
Aug 26 17:46:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-871d22b9-101d-4d21-a94e-47a3bbade660 None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:42 user nova-compute[73110]: WARNING nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 253d1925-ec97-480f-b99b-68942d327b69 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 2faed1ff-2bc7-4e0e-8034-4a893fd82871 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: INFO nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "253d1925-ec97-480f-b99b-68942d327b69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "253d1925-ec97-480f-b99b-68942d327b69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:42 user nova-compute[73110]: INFO nova.compute.manager [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Terminating instance
Aug 26 17:46:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-unplugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] No waiting events found dispatching network-vif-unplugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b82f6f-4f2c-4a55-9088-ceddda45534d req-d20d3c12-691f-44f8-9cf4-673aef61bf89 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-unplugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Starting finish_revert_migration {{(pid=73110) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start _get_guest_xml network_info=[{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '87df7fec-e53b-4018-9f52-96a622043eae', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '84d42b86-03a9-496c-85bd-e643ea8ab023', 'attached_at': '2023-08-26T17:46:43.000000', 'detached_at': '', 'volume_id': '61dd01de-405d-4b62-bd9f-096e972d7e16', 'serial': '61dd01de-405d-4b62-bd9f-096e972d7e16'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:46:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Instance destroyed successfully.
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lazy-loading 'resources' on Instance uuid 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674413544',display_name='tempest-VolumesAdminNegativeTest-server-1674413544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674413544',id=6,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE1bO3NJ48iwvWxDxfmhSNP0F/47x+XoAIFVYrhoRTVWgmPtHSOpsPtYU3LKHq2U0gr6JRArC0iJuQj525zClq4JrYxz1CTbKFUGAqIqFBDdA9sgdRErUm7lXFiD8DhqQ==',key_name='tempest-keypair-710013945',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88799fc21bb642ecb30f13d1b9ba20d7',ramdisk_id='',reservation_id='r-j4mxopf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-154505172',owner_user_name='tempest-VolumesAdminNegativeTest-154505172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07467ef74ea34f21949b8a00da319315',uuid=0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converting VIF {"id": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "address": "fa:16:3e:eb:0c:ff", "network": {"id": "d7d7d437-785d-4813-a023-c086c5b7ff5d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-205196519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88799fc21bb642ecb30f13d1b9ba20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa9fdc0-cb", "ovs_interfaceid": "5fa9fdc0-cb64-4b32-967a-1e9ad346739e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_vif [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fa9fdc0-cb, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: INFO os_vif [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:0c:ff,bridge_name='br-int',has_traffic_filtering=True,id=5fa9fdc0-cb64-4b32-967a-1e9ad346739e,network=Network(d7d7d437-785d-4813-a023-c086c5b7ff5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa9fdc0-cb')
Aug 26 17:46:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Deleting instance files /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282_del
Aug 26 17:46:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Deletion of /opt/stack/data/nova/instances/0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282_del complete
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:43 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:43 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:43 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd83b4-f74a-4f18-9d4b-aa52411f997a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:46:43 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: INFO nova.compute.manager [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a75264-e21c-4fe2-b7f1-59024afc63f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16] added
Aug 26 17:46:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[95965a83-9f04-49c4-bc8c-441e4d6dcd04]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50122d47-f5d3-4867-a587-5ed3ea0cf397]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OknhLjMC" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47167a83-8959-4b8e-a109-d5e751cd7c9a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OknhLjMC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72a1a8-02ff-49fd-a12a-742b84f0a41f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c6ce58-e6b2-4f5c-a079-c87d732d4455]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159107b-18e8-4095-bd9f-6ede5763eb86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:46:43 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49a6cca-fe08-4811-93ec-b9ff2efeba9f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[135567b2-ee46-4620-ae79-1adac3674934]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:44 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece217a9-3540-447c-b803-77838383005b]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:44 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Took 1.15 seconds to deallocate network for instance.
Aug 26 17:46:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-e53056cd-e12e-47a4-baad-97b68a444b17 req-7ebe1c8b-56f0-44e5-9d74-eab1bfe60187 service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-deleted-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdh'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643731383339', 'path': '/dev/sdh'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:46:45 user nova-compute[73110]:   <uuid>84d42b86-03a9-496c-85bd-e643ea8ab023</uuid>
Aug 26 17:46:45 user nova-compute[73110]:   <name>instance-00000003</name>
Aug 26 17:46:45 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:46:45 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:46:45 user nova-compute[73110]:   <metadata>
Aug 26 17:46:45 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:46:45 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherB-server-332987352</nova:name>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:46:43</nova:creationTime>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:46:45 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:46:45 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:owner>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:user uuid="72e7c15b85554d30915b4957791d2d54">tempest-ServerActionsTestOtherB-453496732-project-member</nova:user>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:project uuid="aed9258ba923464ba423b3b9751f56cc">tempest-ServerActionsTestOtherB-453496732</nova:project>
Aug 26 17:46:45 user nova-compute[73110]:       </nova:owner>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:46:45 user nova-compute[73110]:       <nova:ports>
Aug 26 17:46:45 user nova-compute[73110]:         <nova:port uuid="bc99d4df-9d70-45f8-ba11-6965e6f146dc">
Aug 26 17:46:45 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:46:45 user nova-compute[73110]:         </nova:port>
Aug 26 17:46:45 user nova-compute[73110]:       </nova:ports>
Aug 26 17:46:45 user nova-compute[73110]:     </nova:instance>
Aug 26 17:46:45 user nova-compute[73110]:   </metadata>
Aug 26 17:46:45 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:46:45 user nova-compute[73110]:     <system>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="serial">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="uuid">84d42b86-03a9-496c-85bd-e643ea8ab023</entry>
Aug 26 17:46:45 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:46:45 user nova-compute[73110]:     </system>
Aug 26 17:46:45 user nova-compute[73110]:   </sysinfo>
Aug 26 17:46:45 user nova-compute[73110]:   <os>
Aug 26 17:46:45 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:46:45 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:46:45 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:46:45 user nova-compute[73110]:   </os>
Aug 26 17:46:45 user nova-compute[73110]:   <features>
Aug 26 17:46:45 user nova-compute[73110]:     <acpi/>
Aug 26 17:46:45 user nova-compute[73110]:     <apic/>
Aug 26 17:46:45 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:46:45 user nova-compute[73110]:   </features>
Aug 26 17:46:45 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:46:45 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:46:45 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:46:45 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:46:45 user nova-compute[73110]:   </clock>
Aug 26 17:46:45 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:46:45 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:46:45 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:46:45 user nova-compute[73110]:   </cpu>
Aug 26 17:46:45 user nova-compute[73110]:   <devices>
Aug 26 17:46:45 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:46:45 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:46:45 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk"/>
Aug 26 17:46:45 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:46:45 user nova-compute[73110]:     </disk>
Aug 26 17:46:45 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:46:45 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:45 user nova-compute[73110]:       <source dev="/dev/sdh"/>
Aug 26 17:46:45 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:46:45 user nova-compute[73110]:       <serial>61dd01de-405d-4b62-bd9f-096e972d7e16</serial>
Aug 26 17:46:45 user nova-compute[73110]:     </disk>
Aug 26 17:46:45 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:46:45 user nova-compute[73110]:       <mac address="fa:16:3e:58:9f:3c"/>
Aug 26 17:46:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:45 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:46:45 user nova-compute[73110]:       <target dev="tapbc99d4df-9d"/>
Aug 26 17:46:45 user nova-compute[73110]:     </interface>
Aug 26 17:46:45 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:46:45 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/console.log" append="off"/>
Aug 26 17:46:45 user nova-compute[73110]:     </serial>
Aug 26 17:46:45 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:46:45 user nova-compute[73110]:     <video>
Aug 26 17:46:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:46:45 user nova-compute[73110]:     </video>
Aug 26 17:46:45 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:46:45 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:46:45 user nova-compute[73110]:     </rng>
Aug 26 17:46:45 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:46:45 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:46:45 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:46:45 user nova-compute[73110]:     </memballoon>
Aug 26 17:46:45 user nova-compute[73110]:   </devices>
Aug 26 17:46:45 user nova-compute[73110]: </domain>
Aug 26 17:46:45 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG os_vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] Acquiring lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] No waiting events found dispatching network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:45 user nova-compute[73110]: WARNING nova.compute.manager [req-340f1c45-c8c8-4581-b81a-61a51c2a7efa req-194ed799-b5e1-443e-b622-6bc3fd1c80bc service nova] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Received unexpected event network-vif-plugged-5fa9fdc0-cb64-4b32-967a-1e9ad346739e for instance with vm_state deleted and task_state None.
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc99d4df-9d, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc99d4df-9d, col_values=(('external_ids', {'iface-id': 'bc99d4df-9d70-45f8-ba11-6965e6f146dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:9f:3c', 'vm-uuid': '84d42b86-03a9-496c-85bd-e643ea8ab023'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:45 user nova-compute[73110]: INFO os_vif [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:45 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Deleted allocations for instance 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282
Aug 26 17:46:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1d6111ac-c597-4301-a371-838f2011a6e7 tempest-VolumesAdminNegativeTest-154505172 tempest-VolumesAdminNegativeTest-154505172-project-member] Lock "0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:47 user nova-compute[73110]: WARNING nova.compute.manager [req-3d2fa4a0-4cf3-4977-8c12-c96cac6667a6 req-7f34e9ff-fc5e-4b3f-bab0-3a9ad1bd40f9 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state resized and task_state resize_reverting.
Aug 26 17:46:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072009.0056252, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Resumed (Lifecycle Event)
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance running successfully.
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] finish_revert_migration finished successfully. {{(pid=73110) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072009.008009, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Started (Lifecycle Event)
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:46:49 user nova-compute[73110]: WARNING nova.compute.manager [req-661f7462-a03c-440f-b69f-16436e0c6d3e req-119e744f-f2ea-4b97-85cc-6bee85dc15b5 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state resized and task_state resize_reverting.
Aug 26 17:46:49 user nova-compute[73110]: INFO nova.compute.manager [None req-d06238e2-6cd0-4f7f-9146-b8c9533beeb5 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance to original state: 'active'
Aug 26 17:46:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:54 user nova-compute[73110]: INFO nova.compute.manager [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Detaching volume 16ce92dd-4c14-4812-96fa-f01590e810a9
Aug 26 17:46:54 user nova-compute[73110]: INFO nova.virt.block_device [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Attempting to driver detach volume 16ce92dd-4c14-4812-96fa-f01590e810a9 from mountpoint /dev/vdb
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Attempting to detach device vdb from instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:46:54 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:54 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:46:54 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:54 user nova-compute[73110]:   <serial>16ce92dd-4c14-4812-96fa-f01590e810a9</serial>
Aug 26 17:46:54 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:46:54 user nova-compute[73110]: </disk>
Aug 26 17:46:54 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:46:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Successfully detached device vdb from instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc from the persistent domain config.
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:46:54 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:46:54 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:46:54 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:46:54 user nova-compute[73110]:   <serial>16ce92dd-4c14-4812-96fa-f01590e810a9</serial>
Aug 26 17:46:54 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:46:54 user nova-compute[73110]: </disk>
Aug 26 17:46:54 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072015.4117978, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:46:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Successfully detached device vdb from instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc from the live domain config.
Aug 26 17:46:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIiZyvfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:46:55 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9005e22-eece-4c52-8c0f-1982aa368aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93bcdc-c177-4d94-99ef-323854a3c8c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:46:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520f13e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2708361-6f2e-4ba2-a546-661b6eca1213]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f1d62-d758-4b54-a3cd-bdb9353b5624]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6efbe58-3b6d-4976-850e-57a39262b2ce]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.086s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba63318c-0b83-4d8b-9987-57444c03962f]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a62018-32e4-40b8-8e7b-a70ec52a854b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea6498-24b9-4974-bfb4-1ff5a2c90d1e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260]
Aug 26 17:46:55 user nova-compute[73110]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9, portal: 172.16.0.220,3260] successful.
Aug 26 17:46:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ce92dd-4c14-4812-96fa-f01590e810a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bb4f7-5cd6-42ac-80ad-2b3d0c2c61d4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] <== disconnect_volume: return (373ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'flavor' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7155682-8649-4438-88e6-f23c5e8d4d84 tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.193s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072003.5585747, 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:46:58 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] VM Stopped (Lifecycle Event)
Aug 26 17:46:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-36243303-83bd-44df-9697-3770c28d9e9d None None] [instance: 0044f5cc-6edd-4f5a-a8ad-8f46d0bd0282] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:46:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7101MB free_disk=25.429523468017578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 253d1925-ec97-480f-b99b-68942d327b69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e277fb69-1fba-42da-98f6-7b55b892788e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2faed1ff-2bc7-4e0e-8034-4a893fd82871 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:46:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:47:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing instance network info cache due to event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:09 user nova-compute[73110]: DEBUG nova.network.neutron [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updated VIF entry in instance network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-713ac82c-847c-44cc-b21b-e42d66f4f343 req-b2558c79-4dab-477b-9df4-4b95d00d4dde service nova] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:15 user nova-compute[73110]: INFO nova.compute.manager [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Shelving
Aug 26 17:47:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:15 user nova-compute[73110]: WARNING nova.compute.manager [req-e33f8fa3-ff18-4154-a97d-6fd99b6c2b03 req-e9f091b5-77ea-4d75-9e3f-d6cd52ba4a78 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state active and task_state shelving.
Aug 26 17:47:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance destroyed successfully.
Aug 26 17:47:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Beginning cold snapshot process
Aug 26 17:47:16 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:47:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk /opt/stack/data/nova/instances/snapshots/tmpc_rccit3/dc43ecbd5c4e44a98bd64f5fc3fd3ecc {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk /opt/stack/data/nova/instances/snapshots/tmpc_rccit3/dc43ecbd5c4e44a98bd64f5fc3fd3ecc" returned: 0 in 0.653s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:17 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Snapshot extracted, beginning image upload
Aug 26 17:47:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-changed-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Refreshing instance network info cache due to event network-changed-45be2928-8345-4117-ad38-e992f43ebb8a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] Acquiring lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] Acquired lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Refreshing network info cache for port 45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:17 user nova-compute[73110]: WARNING nova.compute.manager [req-5a9de013-bbb8-4dbe-843a-f9f590ce9038 req-103b284d-725c-479f-aefa-e08d68e042cb service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 17:47:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updated VIF entry in instance network info cache for port 45be2928-8345-4117-ad38-e992f43ebb8a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating instance_info_cache with network_info: [{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ade0679-bbe1-4420-bf8e-4e0c4df04792 req-64e00ad1-de57-4f0d-b6db-8c307996b0da service nova] Releasing lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Snapshot image upload complete
Aug 26 17:47:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:19 user nova-compute[73110]: INFO nova.compute.manager [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Shelve offloading
Aug 26 17:47:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance destroyed successfully.
Aug 26 17:47:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:47:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance destroyed successfully.
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'resources' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiQhqTDtKrFX1L/2k2BPbeFPcIx9Dqv0wygQtrma1XCnxRE2QRpxl/L3gRfi7ZNWt9BNE+kb42vyxBj9a2nDWN8/Og4gyoZy2aQUo+1M1nags1woJmceUS+SEb9dtSGPA==',key_name='tempest-keypair-1356496581',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:47:19.308858',shelved_host='user',shelved_image_id='93103acd-f9be-48cc-a677-40958464dd71'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG os_vif [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap022f585c-5c, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing instance network info cache due to event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:20 user nova-compute[73110]: INFO os_vif [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c')
Aug 26 17:47:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Deleting instance files /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e_del
Aug 26 17:47:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Deletion of /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e_del complete
Aug 26 17:47:20 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Deleted allocations for instance e277fb69-1fba-42da-98f6-7b55b892788e
Aug 26 17:47:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'numa_topology' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.objects.base [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e277fb69-1fba-42da-98f6-7b55b892788e> lazy-loaded attributes: resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:47:20 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updated VIF entry in instance network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap022f585c-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9c16a234-2db1-49c8-8e6f-0e1ffbcda73a req-5e0fd57e-2a3b-424e-a220-897c95741842 service nova] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5dfa4a4-64f6-41d3-837a-c697a40e15c6 tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.653s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.169s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:22 user nova-compute[73110]: INFO nova.compute.manager [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Attaching volume 8ee52f3a-8aaa-43df-840b-357b9350724f to /dev/vdb
Aug 26 17:47:22 user nova-compute[73110]: DEBUG os_brick.utils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2e013-aa9f-450f-b231-bd2c072a3e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e6a797-5532-4384-b4c2-a3a32b34061e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9cfad-3786-4f67-84c2-c6cb2111665e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[32395e43-b79f-4019-a696-812d64491014]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:47:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:47:23 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:47:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2fdbbc-5544-4e49-bd2a-3395cc604c65]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG os_brick.utils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating existing volume attachment record: c31dc510-efd7-46be-ad6f-d7e7f61894f1 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:47:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:31 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072036.0489202, e277fb69-1fba-42da-98f6-7b55b892788e => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:47:31 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Stopped (Lifecycle Event)
Aug 26 17:47:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7f43b624-a728-476e-b46b-ac65f3860931 None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGhZcpsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:47:34 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:47:34 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:47:34 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5547eb8-66a9-4ced-9b3d-59535cdc5b52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:47:34 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[39696b16-f4dc-467f-b61f-4ecf32f1d305]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f] added
Aug 26 17:47:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf011a54-3d6e-4a72-8a1e-58ab5cb9e384]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5abb31-0936-47a6-b228-9ad135f79872]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGhZcpsJ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGhZcpsJ" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc33a4e-9c0c-4f07-94dd-ecd293b56569]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGhZcpsJ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136e9c1-c760-4c2c-83b1-6d391ce5d3d1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc3806e-101f-410c-9ae9-611cfa808489]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a46e5-652b-4e6d-8e59-2c3a7e5ec862]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260]
Aug 26 17:47:34 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260] successful.
Aug 26 17:47:34 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[61222d7c-9487-4cc7-9783-ba3708d7e491]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c582f31e-5d72-4412-8784-24e753c19c44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:35 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:35 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:35 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be1dc01-50ea-45c6-ba2f-beddb414876b]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGhZcpsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:47:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23331646133353236', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331646133353236', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:47:36 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:47:36 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:47:36 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:47:36 user nova-compute[73110]:   <serial>8ee52f3a-8aaa-43df-840b-357b9350724f</serial>
Aug 26 17:47:36 user nova-compute[73110]: </disk>
Aug 26 17:47:36 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:7d:09:ed, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5776d6fa-afa3-482d-9f04-e068a7f9f6ee tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.793s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-changed-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing instance network info cache due to event network-changed-bdf99d67-c2bc-48b8-a630-e41da0f43ae1. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] Acquiring lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] Acquired lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:39 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Refreshing network info cache for port bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updated VIF entry in instance network info cache for port bdf99d67-c2bc-48b8-a630-e41da0f43ae1. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a52efd5-8be3-4e94-84c3-30c5daba99eb req-24a91abb-cf7c-408f-bf31-feef36ff72e7 service nova] Releasing lock "refresh_cache-253d1925-ec97-480f-b99b-68942d327b69" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:40 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:47:40 user nova-compute[73110]: INFO nova.compute.claims [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Claim successful on node user
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:47:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:47:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Creating image(s)
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.policy [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b760f93150047f2b46656642fe57efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9df13541045f0b8baace5322a08c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk 1073741824" returned: 0 in 0.046s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:47:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Cannot resize image /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Ensure instance console log exists: /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: INFO nova.compute.manager [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Terminating instance
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d0ad729-ad82-46a9-a59a-86d6106c0409 req-35d35966-7837-4fb0-8018-cab6ba61b423 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Successfully created port: 8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-11e8aa42-c2a9-4cb0-85b6-a9be48248fa7 req-77c93588-c465-43b9-9f19-3182d9912f62 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-5dd5b3f1-aeed-4783-823d-734642209466 req-22082fd7-c558-4245-81c2-850fdbb7e6ae service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-a43208c1-62da-4efa-b040-4f7e47e8b34a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Instance destroyed successfully.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.objects.instance [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lazy-loading 'resources' on Instance uuid 253d1925-ec97-480f-b99b-68942d327b69 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdf99d67-c2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:99:22,bridge_name='br-int',has_traffic_filtering=True,id=bdf99d67-c2bc-48b8-a630-e41da0f43ae1,network=Network(ff9ca02a-ee7f-44d5-9564-fd94531fbf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf99d67-c2')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap832ca559-80, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:aa,bridge_name='br-int',has_traffic_filtering=True,id=832ca559-80a3-4851-ae44-a800f04ed67f,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap832ca559-80')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee5d5cb-a2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2ee5d5cb-a2d2-467e-b649-41b68830a249,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee5d5cb-a2')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap130ca0c1-6d, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b7:cf,bridge_name='br-int',has_traffic_filtering=True,id=130ca0c1-6df7-489b-b320-806099d3c26b,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ca0c1-6d')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "address": "fa:16:3e:ed:d7:4c", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa43208c1-62", "ovs_interfaceid": "a43208c1-62da-4efa-b040-4f7e47e8b34a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa43208c1-62, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:d7:4c,bridge_name='br-int',has_traffic_filtering=True,id=a43208c1-62da-4efa-b040-4f7e47e8b34a,network=Network(e167b857-2822-4af9-aac8-ac44f3bdc6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa43208c1-62')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap737d387c-f6, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7f:b0,bridge_name='br-int',has_traffic_filtering=True,id=737d387c-f6ef-456b-9e6d-9bc2819bdf98,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737d387c-f6')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942812038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942812038',id=14,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnXY6jag7kzrYA0DGIJ190YVrf8W6q3zWX3QBwK5WvJq3fdkbdRVzlPcFteYm79V1Utjw9KnqbMyxM/g23sJHACp6q/nJuqvEwQWKS8Tat03gO4WQp1aW0K+gVyQJi5Ew==',key_name='tempest-keypair-845265985',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94497159fb204730a1e1caa4cbd1c4ee',ramdisk_id='',reservation_id='r-g2xgvijo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1744838706',owner_user_name='tempest-TaggedBootDevicesTest-1744838706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41b4e420b9054bc7ba61d6650aa255b4',uuid=253d1925-ec97-480f-b99b-68942d327b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converting VIF {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape667c685-08, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:44 user nova-compute[73110]: INFO os_vif [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:be:48,bridge_name='br-int',has_traffic_filtering=True,id=e667c685-08c3-4b5d-882b-c1cddecb161e,network=Network(aaf1242e-c1a4-47c7-951e-afcbd3a542cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape667c685-08')
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtVxrGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf170f-002c-4caa-8c6f-391919de2d4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2843601d-6785-4747-9826-fac9d81ba022]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:44 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:44 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:44 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544113c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9ff71f-29f5-48f9-9554-be3c7cdd9747]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d27c9-83bb-4e48-96eb-16587a7cd6bc]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 for instance with vm_state active and task_state deleting.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-832ca559-80a3-4851-ae44-a800f04ed67f for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING nova.compute.manager [req-25b3e885-261c-48e5-96f7-6337e2a6d4f2 req-db5cbc42-c8ed-4418-93c9-86fdd3393bf1 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-832ca559-80a3-4851-ae44-a800f04ed67f for instance with vm_state active and task_state deleting.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de8661-fb06-4d5d-ae91-bc2232c7eda6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e34e15-186e-4c7c-b17c-0634dc9e87c1]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-2ee5d5cb-a2d2-467e-b649-41b68830a249 for instance with vm_state active and task_state deleting.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-130ca0c1-6df7-489b-b320-806099d3c26b for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-130ca0c1-6df7-489b-b320-806099d3c26b for instance with vm_state active and task_state deleting.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:44 user nova-compute[73110]: WARNING nova.compute.manager [req-391b2f02-e730-4b50-a2bb-8cec8ca966db req-8342a7d3-0629-4f50-99e7-99291d1a93ab service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-737d387c-f6ef-456b-9e6d-9bc2819bdf98 for instance with vm_state active and task_state deleting.
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af479f-5d9c-4346-9ed4-87738a0e2b5d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca267ce-f83a-48d6-88dd-c10448a513af]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260]
Aug 26 17:47:45 user nova-compute[73110]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a, portal: 172.16.0.220,3260] successful.
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Successfully updated port: 8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:640e900b-27b9-409c-b9a3-889be0768f9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquired lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1ebd1-3eac-4eb3-96da-1a5d6dae3116]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== disconnect_volume: return (378ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEzKjuxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:47:45 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3669c-2d5f-4a31-87df-88c7c9b08764]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff11f0-293d-45ab-9f70-a79681cd3152]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd573bd29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2'): ({'sdf'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Removing single pathed devices sdf {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d31ed-1f7a-4b60-9869-3c238d2d07b2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97311f73-c254-4b9d-8d1d-1423319d9283]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Flushing IO for device /dev/sdf {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc4a8b-79ce-4b13-b3bb-4208ac09a97d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.148s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bed6c7-aa6e-4bbe-886a-837272cb7234]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef49721a-9b0e-4a7a-9ec3-bcec2c080eac]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66b8321-96ab-4d92-af29-043835f60c5c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260]
Aug 26 17:47:45 user nova-compute[73110]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2, portal: 172.16.0.220,3260] successful.
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e141ab67-8feb-43d2-8976-4954fc9bf1e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[945fc600-7ae0-4c09-a104-7a09d388fd7d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== disconnect_volume: return (447ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruiansLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:47:45 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3314f6-bdb5-4bd9-966d-a38f2d25e775]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e1f4e-2891-40da-8904-bb05faf356a1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:47:45 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd573bd29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417'): ({'sdg'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Removing single pathed devices sdg {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:45 user nova-compute[73110]: INFO nova.compute.manager [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Terminating instance
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updating instance_info_cache with network_info: [{"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cfa4a6-dce3-4cff-af6c-8c0f524c7de4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Releasing lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Instance network_info: |[{"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Start _get_guest_xml network_info=[{"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:47:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:47:45 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f12b7-6214-4886-b58a-780f1d3b6dd8]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Flushing IO for device /dev/sdg {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914866531',display_name='tempest-AttachVolumeNegativeTest-server-1914866531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914866531',id=19,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh+tEZeGSy9XuzqqfgzYfZlkyXEcJ8o1aLt1Xa1jSIH+PCztadCxGRGyAqR55EsdDV0CK7vAr6c7Ns0566Yd6Huwak3rYiIy7WbE4UvkwlaKNbuTvR4jtYscx2DVIkBlA==',key_name='tempest-keypair-429359922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-kffywfxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=d7a5300c-1631-4054-b657-f07ce5f8b3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'pci_devices' on Instance uuid d7a5300c-1631-4054-b657-f07ce5f8b3b6 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b31bc-de99-45dc-b5c9-6a439ed8b168]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:47:45 user nova-compute[73110]:   <uuid>d7a5300c-1631-4054-b657-f07ce5f8b3b6</uuid>
Aug 26 17:47:45 user nova-compute[73110]:   <name>instance-00000013</name>
Aug 26 17:47:45 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:47:45 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:47:45 user nova-compute[73110]:   <metadata>
Aug 26 17:47:45 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:47:45 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1914866531</nova:name>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:47:45</nova:creationTime>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:47:45 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:47:45 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:owner>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:user uuid="3b760f93150047f2b46656642fe57efc">tempest-AttachVolumeNegativeTest-650369-project-member</nova:user>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:project uuid="d0d9df13541045f0b8baace5322a08c4">tempest-AttachVolumeNegativeTest-650369</nova:project>
Aug 26 17:47:45 user nova-compute[73110]:       </nova:owner>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:47:45 user nova-compute[73110]:       <nova:ports>
Aug 26 17:47:45 user nova-compute[73110]:         <nova:port uuid="8866d19d-f9b2-4e1c-9931-d575659cd38b">
Aug 26 17:47:45 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:47:45 user nova-compute[73110]:         </nova:port>
Aug 26 17:47:45 user nova-compute[73110]:       </nova:ports>
Aug 26 17:47:45 user nova-compute[73110]:     </nova:instance>
Aug 26 17:47:45 user nova-compute[73110]:   </metadata>
Aug 26 17:47:45 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:47:45 user nova-compute[73110]:     <system>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="serial">d7a5300c-1631-4054-b657-f07ce5f8b3b6</entry>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="uuid">d7a5300c-1631-4054-b657-f07ce5f8b3b6</entry>
Aug 26 17:47:45 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:47:45 user nova-compute[73110]:     </system>
Aug 26 17:47:45 user nova-compute[73110]:   </sysinfo>
Aug 26 17:47:45 user nova-compute[73110]:   <os>
Aug 26 17:47:45 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:47:45 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:47:45 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:47:45 user nova-compute[73110]:   </os>
Aug 26 17:47:45 user nova-compute[73110]:   <features>
Aug 26 17:47:45 user nova-compute[73110]:     <acpi/>
Aug 26 17:47:45 user nova-compute[73110]:     <apic/>
Aug 26 17:47:45 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:47:45 user nova-compute[73110]:   </features>
Aug 26 17:47:45 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:47:45 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:47:45 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:47:45 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:47:45 user nova-compute[73110]:   </clock>
Aug 26 17:47:45 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:47:45 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:47:45 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:47:45 user nova-compute[73110]:   </cpu>
Aug 26 17:47:45 user nova-compute[73110]:   <devices>
Aug 26 17:47:45 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:47:45 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:47:45 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk"/>
Aug 26 17:47:45 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:47:45 user nova-compute[73110]:     </disk>
Aug 26 17:47:45 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:47:45 user nova-compute[73110]:       <mac address="fa:16:3e:9b:e1:57"/>
Aug 26 17:47:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:47:45 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:47:45 user nova-compute[73110]:       <target dev="tap8866d19d-f9"/>
Aug 26 17:47:45 user nova-compute[73110]:     </interface>
Aug 26 17:47:45 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:47:45 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/console.log" append="off"/>
Aug 26 17:47:45 user nova-compute[73110]:     </serial>
Aug 26 17:47:45 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:47:45 user nova-compute[73110]:     <video>
Aug 26 17:47:45 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:47:45 user nova-compute[73110]:     </video>
Aug 26 17:47:45 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:47:45 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:47:45 user nova-compute[73110]:     </rng>
Aug 26 17:47:45 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:47:45 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:47:45 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:47:45 user nova-compute[73110]:     </memballoon>
Aug 26 17:47:45 user nova-compute[73110]:   </devices>
Aug 26 17:47:45 user nova-compute[73110]: </domain>
Aug 26 17:47:45 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914866531',display_name='tempest-AttachVolumeNegativeTest-server-1914866531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914866531',id=19,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh+tEZeGSy9XuzqqfgzYfZlkyXEcJ8o1aLt1Xa1jSIH+PCztadCxGRGyAqR55EsdDV0CK7vAr6c7Ns0566Yd6Huwak3rYiIy7WbE4UvkwlaKNbuTvR4jtYscx2DVIkBlA==',key_name='tempest-keypair-429359922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-kffywfxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=d7a5300c-1631-4054-b657-f07ce5f8b3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_vif [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8866d19d-f9, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8866d19d-f9, col_values=(('external_ids', {'iface-id': '8866d19d-f9b2-4e1c-9931-d575659cd38b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:e1:57', 'vm-uuid': 'd7a5300c-1631-4054-b657-f07ce5f8b3b6'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19643580-675f-4432-96d9-93c56b79f027]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] SCSI volumes sdg have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dce532-13dc-47ea-8085-15d522675fc7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: INFO os_vif [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9')
Aug 26 17:47:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b4470b-79f0-47ce-b00e-226c27d21a1a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260]
Aug 26 17:47:45 user nova-compute[73110]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417, portal: 172.16.0.220,3260] successful.
Aug 26 17:47:45 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:9b:e1:57, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d87afb-8c1f-4c27-82ef-2357f3b59417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a9fe0-9f63-4da3-a9df-0c39993b476f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] <== disconnect_volume: return (399ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:47:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:47:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Deleting instance files /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69_del
Aug 26 17:47:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Deletion of /opt/stack/data/nova/instances/253d1925-ec97-480f-b99b-68942d327b69_del complete
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:46 user nova-compute[73110]: WARNING nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-a43208c1-62da-4efa-b040-4f7e47e8b34a for instance with vm_state active and task_state deleting.
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-unplugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-unplugged-e667c685-08c3-4b5d-882b-c1cddecb161e for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-changed-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Refreshing instance network info cache due to event network-changed-8866d19d-f9b2-4e1c-9931-d575659cd38b. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Acquiring lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Acquired lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Refreshing network info cache for port 8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:46 user nova-compute[73110]: INFO nova.compute.manager [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Took 3.75 seconds to destroy the instance on the hypervisor.
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updated VIF entry in instance network info cache for port 8866d19d-f9b2-4e1c-9931-d575659cd38b. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updating instance_info_cache with network_info: [{"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Releasing lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Acquiring lock "253d1925-ec97-480f-b99b-68942d327b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] Lock "253d1925-ec97-480f-b99b-68942d327b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] No waiting events found dispatching network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:46 user nova-compute[73110]: WARNING nova.compute.manager [req-d9b1774e-59b0-4f65-8318-1f213abb9011 req-23a90fa0-94cc-4b59-888d-f505eee07792 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received unexpected event network-vif-plugged-e667c685-08c3-4b5d-882b-c1cddecb161e for instance with vm_state active and task_state deleting.
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-unplugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Acquiring lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] No waiting events found dispatching network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:47 user nova-compute[73110]: WARNING nova.compute.manager [req-b416e7d7-4504-40e4-b99b-25d1ceb5b6d3 req-7523d258-8241-4c03-92f5-4ffb94b8c8de service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received unexpected event network-vif-plugged-215e0790-c265-4add-b5be-a21efa2c1bd4 for instance with vm_state active and task_state deleting.
Aug 26 17:47:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Instance destroyed successfully.
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lazy-loading 'resources' on Instance uuid 2207fd05-7b0c-4b99-bad7-46c1707ec1bc {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-888669765',display_name='tempest-ServerStableDeviceRescueTest-server-888669765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-888669765',id=4,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbuFk+K1pxZR9a4QvkWecbUi3JuCbGRz7lFcJX3ParM12ZMFodvkAui0Sq9NhYW1f+r5L73YYv1YVCMiB80dvvwaNpeAm9ThsOnzEsXu6/7/ENeE7J5wD/bjJwTv4BBQ==',key_name='tempest-keypair-38390506',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='698cfee557244870b583fadf02e52a69',ramdisk_id='',reservation_id='r-pamlg4rx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-281478421',owner_user_name='tempest-ServerStableDeviceRescueTest-281478421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952334e4f9ae44ba841a0b8f200a56ea',uuid=2207fd05-7b0c-4b99-bad7-46c1707ec1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converting VIF {"id": "215e0790-c265-4add-b5be-a21efa2c1bd4", "address": "fa:16:3e:3f:73:c7", "network": {"id": "757ebd45-d4e0-4ed5-a685-24ea2615d7de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-728777128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698cfee557244870b583fadf02e52a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215e0790-c2", "ovs_interfaceid": "215e0790-c265-4add-b5be-a21efa2c1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG os_vif [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap215e0790-c2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: INFO os_vif [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=215e0790-c265-4add-b5be-a21efa2c1bd4,network=Network(757ebd45-d4e0-4ed5-a685-24ea2615d7de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215e0790-c2')
Aug 26 17:47:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Deleting instance files /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc_del
Aug 26 17:47:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Deletion of /opt/stack/data/nova/instances/2207fd05-7b0c-4b99-bad7-46c1707ec1bc_del complete
Aug 26 17:47:47 user nova-compute[73110]: INFO nova.compute.manager [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Took 1.71 seconds to destroy the instance on the hypervisor.
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:47 user nova-compute[73110]: WARNING nova.compute.manager [req-d38378e5-6b47-4c26-a31a-859d7f5b722f req-02e826b3-650e-4f6f-8589-2869ad612ac6 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state building and task_state spawning.
Aug 26 17:47:48 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:48 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Took 1.11 seconds to deallocate network for instance.
Aug 26 17:47:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-5381137a-e1ca-4bd0-924b-2c002ded0733 req-fab1aab0-7368-4046-b7d0-332b150987a6 service nova] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Received event network-vif-deleted-215e0790-c265-4add-b5be-a21efa2c1bd4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:48 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:47:48 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:47:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:48 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Deleted allocations for instance 2207fd05-7b0c-4b99-bad7-46c1707ec1bc
Aug 26 17:47:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1b702b1e-a2f4-4bd8-af00-3f1e2d99683d tempest-ServerStableDeviceRescueTest-281478421 tempest-ServerStableDeviceRescueTest-281478421-project-member] Lock "2207fd05-7b0c-4b99-bad7-46c1707ec1bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.367s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072069.7699819, d7a5300c-1631-4054-b657-f07ce5f8b3b6 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] VM Resumed (Lifecycle Event)
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Instance spawned successfully.
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072069.770782, d7a5300c-1631-4054-b657-f07ce5f8b3b6 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] VM Started (Lifecycle Event)
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:47:49 user nova-compute[73110]: INFO nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Took 8.63 seconds to spawn the instance on the hypervisor.
Aug 26 17:47:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-deleted-a43208c1-62da-4efa-b040-4f7e47e8b34a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:50 user nova-compute[73110]: INFO nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Neutron deleted interface a43208c1-62da-4efa-b040-4f7e47e8b34a; detaching it from the instance and deleting it from the info cache
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "130ca0c1-6df7-489b-b320-806099d3c26b", "address": "fa:16:3e:93:b7:cf", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ca0c1-6d", "ovs_interfaceid": "130ca0c1-6df7-489b-b320-806099d3c26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:50 user nova-compute[73110]: INFO nova.compute.manager [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Took 9.41 seconds to build instance.
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Detach interface failed, port_id=a43208c1-62da-4efa-b040-4f7e47e8b34a, reason: Instance 253d1925-ec97-480f-b99b-68942d327b69 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:47:50 user nova-compute[73110]: WARNING nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state building and task_state spawning.
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-deleted-130ca0c1-6df7-489b-b320-806099d3c26b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:50 user nova-compute[73110]: INFO nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Neutron deleted interface 130ca0c1-6df7-489b-b320-806099d3c26b; detaching it from the instance and deleting it from the info cache
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e667c685-08c3-4b5d-882b-c1cddecb161e", "address": "fa:16:3e:a4:be:48", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape667c685-08", "ovs_interfaceid": "e667c685-08c3-4b5d-882b-c1cddecb161e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a50ad8dd-48d0-44eb-a3a0-5a2c57701f6e tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.532s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Detach interface failed, port_id=130ca0c1-6df7-489b-b320-806099d3c26b, reason: Instance 253d1925-ec97-480f-b99b-68942d327b69 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-deleted-e667c685-08c3-4b5d-882b-c1cddecb161e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:50 user nova-compute[73110]: INFO nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Neutron deleted interface e667c685-08c3-4b5d-882b-c1cddecb161e; detaching it from the instance and deleting it from the info cache
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [{"id": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "address": "fa:16:3e:96:99:22", "network": {"id": "ff9ca02a-ee7f-44d5-9564-fd94531fbf07", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1805905523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf99d67-c2", "ovs_interfaceid": "bdf99d67-c2bc-48b8-a630-e41da0f43ae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "832ca559-80a3-4851-ae44-a800f04ed67f", "address": "fa:16:3e:6e:97:aa", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap832ca559-80", "ovs_interfaceid": "832ca559-80a3-4851-ae44-a800f04ed67f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "address": "fa:16:3e:bc:5d:1f", "network": {"id": "e167b857-2822-4af9-aac8-ac44f3bdc6c4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1842733373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee5d5cb-a2", "ovs_interfaceid": "2ee5d5cb-a2d2-467e-b649-41b68830a249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "address": "fa:16:3e:d9:7f:b0", "network": {"id": "aaf1242e-c1a4-47c7-951e-afcbd3a542cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-217652843", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94497159fb204730a1e1caa4cbd1c4ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737d387c-f6", "ovs_interfaceid": "737d387c-f6ef-456b-9e6d-9bc2819bdf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e49499c-cfa8-43a3-a1b9-6488cd591e62 req-d7ae67e5-48fa-44fe-8ca6-859d9909fb07 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Detach interface failed, port_id=e667c685-08c3-4b5d-882b-c1cddecb161e, reason: Instance 253d1925-ec97-480f-b99b-68942d327b69 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:47:51 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:51 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Took 5.10 seconds to deallocate network for instance.
Aug 26 17:47:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf50317-4025-400f-ad20-3ca19d07907f req-5580880e-5db1-4c6d-9262-078f2c050d72 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-deleted-737d387c-f6ef-456b-9e6d-9bc2819bdf98 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf50317-4025-400f-ad20-3ca19d07907f req-5580880e-5db1-4c6d-9262-078f2c050d72 service nova] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Received event network-vif-deleted-bdf99d67-c2bc-48b8-a630-e41da0f43ae1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:53 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:53 user nova-compute[73110]: INFO nova.compute.manager [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Took 2.78 seconds to detach 3 volumes for instance.
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.222s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:47:54 user nova-compute[73110]: INFO nova.compute.claims [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Claim successful on node user
Aug 26 17:47:54 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Deleted allocations for instance 253d1925-ec97-480f-b99b-68942d327b69
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-638d5b7d-cd6d-41c3-a94c-e66794b8d2e3 tempest-TaggedBootDevicesTest-1744838706 tempest-TaggedBootDevicesTest-1744838706-project-member] Lock "253d1925-ec97-480f-b99b-68942d327b69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.253s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:47:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:47:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:47:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Creating image(s)
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "/opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "/opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "/opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.policy [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d8f33fb4e7447d4b696e89192fc3a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e8e8d866a04e429135ef1baa0059f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.210s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk 1073741824" returned: 0 in 0.058s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:47:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Cannot resize image /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Ensure instance console log exists: /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Successfully created port: d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [{"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-84d42b86-03a9-496c-85bd-e643ea8ab023" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Successfully updated port: d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquired lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-changed-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Refreshing instance network info cache due to event network-changed-d60f1868-9458-47a6-98d5-e044d65d51b4. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] Acquiring lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updating instance_info_cache with network_info: [{"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Releasing lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Instance network_info: |[{"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] Acquired lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Refreshing network info cache for port d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Start _get_guest_xml network_info=[{"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:47:57 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:47:57 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-176123935',display_name='tempest-ServersNegativeTestJSON-server-176123935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-176123935',id=20,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-i9s9sv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:47:55Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=e575d87f-237e-4159-82e8-fe46f6b9d680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lazy-loading 'pci_devices' on Instance uuid e575d87f-237e-4159-82e8-fe46f6b9d680 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:47:57 user nova-compute[73110]:   <uuid>e575d87f-237e-4159-82e8-fe46f6b9d680</uuid>
Aug 26 17:47:57 user nova-compute[73110]:   <name>instance-00000014</name>
Aug 26 17:47:57 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:47:57 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:47:57 user nova-compute[73110]:   <metadata>
Aug 26 17:47:57 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:47:57 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:name>tempest-ServersNegativeTestJSON-server-176123935</nova:name>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:47:57</nova:creationTime>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:47:57 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:47:57 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:owner>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:user uuid="8d8f33fb4e7447d4b696e89192fc3a3e">tempest-ServersNegativeTestJSON-794179261-project-member</nova:user>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:project uuid="18e8e8d866a04e429135ef1baa0059f0">tempest-ServersNegativeTestJSON-794179261</nova:project>
Aug 26 17:47:57 user nova-compute[73110]:       </nova:owner>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:47:57 user nova-compute[73110]:       <nova:ports>
Aug 26 17:47:57 user nova-compute[73110]:         <nova:port uuid="d60f1868-9458-47a6-98d5-e044d65d51b4">
Aug 26 17:47:57 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:47:57 user nova-compute[73110]:         </nova:port>
Aug 26 17:47:57 user nova-compute[73110]:       </nova:ports>
Aug 26 17:47:57 user nova-compute[73110]:     </nova:instance>
Aug 26 17:47:57 user nova-compute[73110]:   </metadata>
Aug 26 17:47:57 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:47:57 user nova-compute[73110]:     <system>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="serial">e575d87f-237e-4159-82e8-fe46f6b9d680</entry>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="uuid">e575d87f-237e-4159-82e8-fe46f6b9d680</entry>
Aug 26 17:47:57 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:47:57 user nova-compute[73110]:     </system>
Aug 26 17:47:57 user nova-compute[73110]:   </sysinfo>
Aug 26 17:47:57 user nova-compute[73110]:   <os>
Aug 26 17:47:57 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:47:57 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:47:57 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:47:57 user nova-compute[73110]:   </os>
Aug 26 17:47:57 user nova-compute[73110]:   <features>
Aug 26 17:47:57 user nova-compute[73110]:     <acpi/>
Aug 26 17:47:57 user nova-compute[73110]:     <apic/>
Aug 26 17:47:57 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:47:57 user nova-compute[73110]:   </features>
Aug 26 17:47:57 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:47:57 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:47:57 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:47:57 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:47:57 user nova-compute[73110]:   </clock>
Aug 26 17:47:57 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:47:57 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:47:57 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:47:57 user nova-compute[73110]:   </cpu>
Aug 26 17:47:57 user nova-compute[73110]:   <devices>
Aug 26 17:47:57 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:47:57 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:47:57 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk"/>
Aug 26 17:47:57 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:47:57 user nova-compute[73110]:     </disk>
Aug 26 17:47:57 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:47:57 user nova-compute[73110]:       <mac address="fa:16:3e:c1:a0:bb"/>
Aug 26 17:47:57 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:47:57 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:47:57 user nova-compute[73110]:       <target dev="tapd60f1868-94"/>
Aug 26 17:47:57 user nova-compute[73110]:     </interface>
Aug 26 17:47:57 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:47:57 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/console.log" append="off"/>
Aug 26 17:47:57 user nova-compute[73110]:     </serial>
Aug 26 17:47:57 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:47:57 user nova-compute[73110]:     <video>
Aug 26 17:47:57 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:47:57 user nova-compute[73110]:     </video>
Aug 26 17:47:57 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:47:57 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:47:57 user nova-compute[73110]:     </rng>
Aug 26 17:47:57 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:47:57 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:47:57 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:47:57 user nova-compute[73110]:     </memballoon>
Aug 26 17:47:57 user nova-compute[73110]:   </devices>
Aug 26 17:47:57 user nova-compute[73110]: </domain>
Aug 26 17:47:57 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-176123935',display_name='tempest-ServersNegativeTestJSON-server-176123935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-176123935',id=20,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-i9s9sv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:47:55Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=e575d87f-237e-4159-82e8-fe46f6b9d680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG os_vif [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd60f1868-94, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd60f1868-94, col_values=(('external_ids', {'iface-id': 'd60f1868-9458-47a6-98d5-e044d65d51b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:a0:bb', 'vm-uuid': 'e575d87f-237e-4159-82e8-fe46f6b9d680'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:57 user nova-compute[73110]: INFO os_vif [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94')
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] No VIF found with MAC fa:16:3e:c1:a0:bb, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updated VIF entry in instance network info cache for port d60f1868-9458-47a6-98d5-e044d65d51b4. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updating instance_info_cache with network_info: [{"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5fb85588-9b4f-47aa-8237-a8fb40cebe42 req-4ef301af-290b-4792-9a87-17a8dcd1df27 service nova] Releasing lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-changed-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Refreshing instance network info cache due to event network-changed-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] Acquiring lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] Acquired lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG nova.network.neutron [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Refreshing network info cache for port d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:47:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072064.26924, 253d1925-ec97-480f-b99b-68942d327b69 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:47:59 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 253d1925-ec97-480f-b99b-68942d327b69] VM Stopped (Lifecycle Event)
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-c1f63fa1-f64b-4f7e-bd27-2aa5ca8497d7 None None] [instance: 253d1925-ec97-480f-b99b-68942d327b69] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updated VIF entry in instance network info cache for port d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating instance_info_cache with network_info: [{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf06780-7b37-4281-aacf-0451b9c3542e req-db2f24d3-2949-4ccc-ac23-9f22b9edfe7f service nova] Releasing lock "refresh_cache-2faed1ff-2bc7-4e0e-8034-4a893fd82871" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'info_cache' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:47:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:00 user nova-compute[73110]: INFO nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Rebuilding instance
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] No waiting events found dispatching network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:00 user nova-compute[73110]: WARNING nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received unexpected event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 for instance with vm_state building and task_state spawning.
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] No waiting events found dispatching network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:00 user nova-compute[73110]: WARNING nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received unexpected event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 for instance with vm_state building and task_state spawning.
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:00 user nova-compute[73110]: WARNING nova.compute.manager [req-9dedfb0c-080a-49a0-8fb1-76b59f5f13c9 req-68defde3-b241-4427-84be-50a4b6794093 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state active and task_state rebuilding.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance destroyed successfully.
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance destroyed successfully.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1405059155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1dd4f93-8b, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance destroyed successfully.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'resources' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:01 user nova-compute[73110]: INFO os_vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b')
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:01 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf549c20-9f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb38e13b-0d8d-4b5c-90f9-04ed8e543f31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072081.3812795, e575d87f-237e-4159-82e8-fe46f6b9d680 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] VM Resumed (Lifecycle Event)
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf5ac9-cd11-4e3f-b51e-4c6cf04dc568]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:48:01 user nova-compute[73110]: INFO os_vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:01 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:01 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:01 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54461dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start _get_guest_xml network_info=[{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'numa_topology' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2365f7-3645-40d7-9fa8-449d13587a39]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Instance spawned successfully.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e4da82-3593-417e-94d1-0527ac3fa273]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:48:01 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072081.3822231, e575d87f-237e-4159-82e8-fe46f6b9d680 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] VM Started (Lifecycle Event)
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50131028-936e-440c-a411-1465e823abef]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d073dc-3999-421b-a027-fb93cb068b13]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d64e44-f7bb-4da2-9d56-4f983f3ed0e1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:48:01 user nova-compute[73110]:   <uuid>7a5294e5-ba09-49bd-b78a-33ebc306d925</uuid>
Aug 26 17:48:01 user nova-compute[73110]:   <name>instance-00000005</name>
Aug 26 17:48:01 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:48:01 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:48:01 user nova-compute[73110]:   <metadata>
Aug 26 17:48:01 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:48:01 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeTestJSON-server-934297327</nova:name>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:48:01</nova:creationTime>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:48:01 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:48:01 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:owner>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:user uuid="65b8f68535c94d32b9178427f2654db8">tempest-AttachVolumeTestJSON-1129991883-project-member</nova:user>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:project uuid="38ce94322c8d42b5a3dbd2af9e84c263">tempest-AttachVolumeTestJSON-1129991883</nova:project>
Aug 26 17:48:01 user nova-compute[73110]:       </nova:owner>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:48:01 user nova-compute[73110]:       <nova:ports>
Aug 26 17:48:01 user nova-compute[73110]:         <nova:port uuid="df549c20-9f92-4f6a-8ba4-90a7ea5605d0">
Aug 26 17:48:01 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 17:48:01 user nova-compute[73110]:         </nova:port>
Aug 26 17:48:01 user nova-compute[73110]:       </nova:ports>
Aug 26 17:48:01 user nova-compute[73110]:     </nova:instance>
Aug 26 17:48:01 user nova-compute[73110]:   </metadata>
Aug 26 17:48:01 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:48:01 user nova-compute[73110]:     <system>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="serial">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="uuid">7a5294e5-ba09-49bd-b78a-33ebc306d925</entry>
Aug 26 17:48:01 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:48:01 user nova-compute[73110]:     </system>
Aug 26 17:48:01 user nova-compute[73110]:   </sysinfo>
Aug 26 17:48:01 user nova-compute[73110]:   <os>
Aug 26 17:48:01 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:48:01 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:48:01 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:48:01 user nova-compute[73110]:   </os>
Aug 26 17:48:01 user nova-compute[73110]:   <features>
Aug 26 17:48:01 user nova-compute[73110]:     <acpi/>
Aug 26 17:48:01 user nova-compute[73110]:     <apic/>
Aug 26 17:48:01 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:48:01 user nova-compute[73110]:   </features>
Aug 26 17:48:01 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:48:01 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:48:01 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:48:01 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:48:01 user nova-compute[73110]:   </clock>
Aug 26 17:48:01 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:48:01 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:48:01 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:48:01 user nova-compute[73110]:   </cpu>
Aug 26 17:48:01 user nova-compute[73110]:   <devices>
Aug 26 17:48:01 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:48:01 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:48:01 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk"/>
Aug 26 17:48:01 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:48:01 user nova-compute[73110]:     </disk>
Aug 26 17:48:01 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:48:01 user nova-compute[73110]:       <mac address="fa:16:3e:ee:a0:36"/>
Aug 26 17:48:01 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:48:01 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:48:01 user nova-compute[73110]:       <target dev="tapdf549c20-9f"/>
Aug 26 17:48:01 user nova-compute[73110]:     </interface>
Aug 26 17:48:01 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:48:01 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/console.log" append="off"/>
Aug 26 17:48:01 user nova-compute[73110]:     </serial>
Aug 26 17:48:01 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:48:01 user nova-compute[73110]:     <video>
Aug 26 17:48:01 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:48:01 user nova-compute[73110]:     </video>
Aug 26 17:48:01 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:48:01 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:48:01 user nova-compute[73110]:     </rng>
Aug 26 17:48:01 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:48:01 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:48:01 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:48:01 user nova-compute[73110]:     </memballoon>
Aug 26 17:48:01 user nova-compute[73110]:   </devices>
Aug 26 17:48:01 user nova-compute[73110]: </domain>
Aug 26 17:48:01 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9662035-b7cf-48bf-a16b-4839481bc378]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]
Aug 26 17:48:01 user nova-compute[73110]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:48:01 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.compute.manager [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Took 7.67 seconds to build instance.
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3b837-269f-4104-b0bb-cd2595b37ecc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fb0128f1-8edb-45c3-b38e-6e12b6311634 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.837s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.603s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== disconnect_volume: return (606ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deleting instance files /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871_del
Aug 26 17:48:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deletion of /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871_del complete
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072067.216393, 2207fd05-7b0c-4b99-bad7-46c1707ec1bc => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:02 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] VM Stopped (Lifecycle Event)
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3fc65531-0157-4de5-9cec-e5972ccaf803 None None] [instance: 2207fd05-7b0c-4b99-bad7-46c1707ec1bc] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:02 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2faed1ff-2bc7-4e0e-8034-4a893fd82871 could not be found.
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcad871-b756-43e6-903d-0383fe516b47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.236s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebf7d0e-3c07-4630-b4a8-78ff77e75eb4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:02 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:02 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:02 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:02 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54447b130>, {}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Disconnecting from: [] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.146s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== disconnect_volume: return (149ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Cannot resize image /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'migration_context' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.objects.base [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Object Instance<7a5294e5-ba09-49bd-b78a-33ebc306d925> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:46:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG os_vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf549c20-9f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf549c20-9f, col_values=(('external_ids', {'iface-id': 'df549c20-9f92-4f6a-8ba4-90a7ea5605d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:a0:36', 'vm-uuid': '7a5294e5-ba09-49bd-b78a-33ebc306d925'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:02 user nova-compute[73110]: INFO os_vif [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:03 user nova-compute[73110]: WARNING nova.compute.manager [req-ace13db2-a75b-42c9-a5ee-ee322292e8e8 req-5fbb5e69-84dc-4c0a-a117-bdc0d730ac6f service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state active and task_state rebuilding.
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-changed-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Refreshing instance network info cache due to event network-changed-c39bb030-e58f-443b-ab28-53d9f1561f5f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] Acquiring lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] Acquired lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Refreshing network info cache for port c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072087.1642935, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Resumed (Lifecycle Event)
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:07 user nova-compute[73110]: WARNING nova.compute.manager [req-75365d31-cafa-400c-a72e-6db997d5fd8a req-87083f2d-ebac-4093-81f0-340451bbcbd5 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state stopped and task_state powering-on.
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:07 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:48:07 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.503204345703125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:07 user nova-compute[73110]: WARNING nova.compute.manager [req-e2e36769-4820-46f3-ac0f-0e147792a6f7 req-77640e93-3959-452f-9349-232a2d1bc8b9 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state stopped and task_state powering-on.
Aug 26 17:48:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance rebooted successfully.
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a41d0d28-f4d8-4f82-a07d-ce799df168d0 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Preparing to wait for external event volume-reimaged-53116ae7-3d6c-447d-9016-36fef4bab6d8 {{(pid=73110) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072087.1651118, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Started (Lifecycle Event)
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2faed1ff-2bc7-4e0e-8034-4a893fd82871 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7a5300c-1631-4054-b657-f07ce5f8b3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.network.neutron [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updated VIF entry in instance network info cache for port c39bb030-e58f-443b-ab28-53d9f1561f5f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.network.neutron [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7831a5d2-8d14-49f5-a8a7-15eb981a3217 req-45cd28bc-8852-458a-8786-89907a3d6e70 service nova] Releasing lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:48:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:09 user nova-compute[73110]: INFO nova.compute.manager [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attaching volume 37d4ad88-7329-4b25-bc68-8bc19e686c7c to /dev/vdb
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.utils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c64600-5aa6-4c0c-8b79-f3642a7a2c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e1b0b3-b030-485c-8e99-bb495a56a6b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac274a-4d3f-4299-b2af-75217d7f23c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d84d68b-e96f-4ee2-8358-24f8cb1220eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:48:09 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:48:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[65217ac5-72ad-45e5-aa86-a7d9da90d929]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG os_brick.utils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:09 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating existing volume attachment record: 34aecb83-92e5-4481-9864-b1aceacc8644 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:48:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:16 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072081.201089, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:16 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Stopped (Lifecycle Event)
Aug 26 17:48:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fac2dbc3-db44-4899-8f99-8b64ce0cd1c6 None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqePjkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:21 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:21 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9c852-4d4c-4b7c-8ecd-fd9656b8c1e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:48:21 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4a6b3-6dcc-4adb-9551-1e55f50d22f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c] added
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17edf4a0-66ca-4128-a297-442c423633c9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c992af-c48d-46bc-8b90-0853e55cce9d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsqePjkt {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsqePjkt" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d87fdc9-b6e5-445b-a663-6bec3110bb19]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsqePjkt'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94c3aa-f729-4503-b839-273fceb80ced]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2b8fc-0dcc-4d28-bc4a-c574c350e683]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91062b31-85c6-4439-a629-42b968004b91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260]
Aug 26 17:48:21 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260] successful.
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac974880-acf3-4f6d-a651-1ef36afe1c8c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7a11e-9372-4c69-a83c-2275f4e690f2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:21 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc41ce2-a03e-4f5c-ac5e-6fa17408d9c9]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:48:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqePjkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:48:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23832336265393063', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832336265393063', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:48:22 user nova-compute[73110]: DEBUG nova.objects.instance [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:48:23 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:48:23 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 17:48:23 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:48:23 user nova-compute[73110]:   <serial>37d4ad88-7329-4b25-bc68-8bc19e686c7c</serial>
Aug 26 17:48:23 user nova-compute[73110]: </disk>
Aug 26 17:48:23 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:48:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:48:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:48:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No VIF found with MAC fa:16:3e:19:82:35, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:48:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-533fe95c-5d77-48b6-bfc1-1b27f820768f tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.063s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 req-231e9d57-f682-4b6b-a0ba-011bf37e1e73 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event volume-reimaged-53116ae7-3d6c-447d-9016-36fef4bab6d8 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 req-231e9d57-f682-4b6b-a0ba-011bf37e1e73 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 req-231e9d57-f682-4b6b-a0ba-011bf37e1e73 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 req-231e9d57-f682-4b6b-a0ba-011bf37e1e73 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 req-231e9d57-f682-4b6b-a0ba-011bf37e1e73 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Processing event volume-reimaged-53116ae7-3d6c-447d-9016-36fef4bab6d8 {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:48:29 user nova-compute[73110]: INFO nova.virt.block_device [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Booting with volume 53116ae7-3d6c-447d-9016-36fef4bab6d8 at /dev/vda
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.utils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022a2c8-8f52-42df-a51e-099d8160c6ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b11e9-1a50-4fdd-97ca-6c2b8270b13f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af2f52-c1e0-40dc-99f2-f6ba4dc752c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5439ec-068b-4f1b-8ea3-ea52dee8259e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:48:29 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:48:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4bcb2f-26e7-4fa8-a0c6-7fdfee0b334d]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG os_brick.utils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:29 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating existing volume attachment record: 0ff1b1f2-9877-492f-a2e9-3cb8b5d8b6f0 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:48:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:48:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Creating image(s)
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Ensure instance console log exists: /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start _get_guest_xml network_info=[{"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0ff1b1f2-9877-492f-a2e9-3cb8b5d8b6f0', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2faed1ff-2bc7-4e0e-8034-4a893fd82871', 'attached_at': '', 'detached_at': '', 'volume_id': '53116ae7-3d6c-447d-9016-36fef4bab6d8', 'serial': '53116ae7-3d6c-447d-9016-36fef4bab6d8'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:48:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 17:48:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2faed1ff-2bc7-4e0e-8034-4a893fd82871 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:41 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:41 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:41 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47493ac5-962a-4ca8-9895-448e01390b89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:48:41 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1604c1-81b4-43d1-bc1d-c3e265853ce7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8] added
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319efbe-919d-4b43-9695-8a2958c73a27]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19294d8-bff0-4bb2-91b8-115f506cc2d9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWLRhgrB {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dWLRhgrB" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b94436-8e28-4b8f-a610-d722cefa7595]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dWLRhgrB'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d342f-55d2-46bc-972d-c2c86bd52559]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[022170e2-2042-432f-8383-64857781d98c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed328d29-95f1-4643-ac25-39f31fe2d23e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]
Aug 26 17:48:41 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b86d8-388a-4436-a545-becf7a9d3b9e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d33e3-0b90-4895-be3a-80d2e1994c36]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:41 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[faff4c40-6d13-425f-820c-6528ceed2d83]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:48:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26264613832353932', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264613832353932', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1405059155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:48:42 user nova-compute[73110]:   <uuid>2faed1ff-2bc7-4e0e-8034-4a893fd82871</uuid>
Aug 26 17:48:42 user nova-compute[73110]:   <name>instance-00000011</name>
Aug 26 17:48:42 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:48:42 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:48:42 user nova-compute[73110]:   <metadata>
Aug 26 17:48:42 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:48:42 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:48:42 user nova-compute[73110]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1405059155</nova:name>
Aug 26 17:48:42 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:48:41</nova:creationTime>
Aug 26 17:48:42 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:48:42 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:48:42 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:48:42 user nova-compute[73110]:       <nova:owner>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:user uuid="5f2fbfd19ab04e91a44dd5a1954f231d">tempest-ServerActionsV293TestJSON-1105370441-project-member</nova:user>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:project uuid="c9a97610a2dc4c1c97890c6645883757">tempest-ServerActionsV293TestJSON-1105370441</nova:project>
Aug 26 17:48:42 user nova-compute[73110]:       </nova:owner>
Aug 26 17:48:42 user nova-compute[73110]:       <nova:ports>
Aug 26 17:48:42 user nova-compute[73110]:         <nova:port uuid="d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1">
Aug 26 17:48:42 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:48:42 user nova-compute[73110]:         </nova:port>
Aug 26 17:48:42 user nova-compute[73110]:       </nova:ports>
Aug 26 17:48:42 user nova-compute[73110]:     </nova:instance>
Aug 26 17:48:42 user nova-compute[73110]:   </metadata>
Aug 26 17:48:42 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:48:42 user nova-compute[73110]:     <system>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="serial">2faed1ff-2bc7-4e0e-8034-4a893fd82871</entry>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="uuid">2faed1ff-2bc7-4e0e-8034-4a893fd82871</entry>
Aug 26 17:48:42 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:48:42 user nova-compute[73110]:     </system>
Aug 26 17:48:42 user nova-compute[73110]:   </sysinfo>
Aug 26 17:48:42 user nova-compute[73110]:   <os>
Aug 26 17:48:42 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:48:42 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:48:42 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:48:42 user nova-compute[73110]:   </os>
Aug 26 17:48:42 user nova-compute[73110]:   <features>
Aug 26 17:48:42 user nova-compute[73110]:     <acpi/>
Aug 26 17:48:42 user nova-compute[73110]:     <apic/>
Aug 26 17:48:42 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:48:42 user nova-compute[73110]:   </features>
Aug 26 17:48:42 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:48:42 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:48:42 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:48:42 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:48:42 user nova-compute[73110]:   </clock>
Aug 26 17:48:42 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:48:42 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:48:42 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:48:42 user nova-compute[73110]:   </cpu>
Aug 26 17:48:42 user nova-compute[73110]:   <devices>
Aug 26 17:48:42 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:48:42 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:48:42 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:48:42 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:48:42 user nova-compute[73110]:       <serial>53116ae7-3d6c-447d-9016-36fef4bab6d8</serial>
Aug 26 17:48:42 user nova-compute[73110]:     </disk>
Aug 26 17:48:42 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:48:42 user nova-compute[73110]:       <mac address="fa:16:3e:eb:9b:41"/>
Aug 26 17:48:42 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:48:42 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:48:42 user nova-compute[73110]:       <target dev="tapd1dd4f93-8b"/>
Aug 26 17:48:42 user nova-compute[73110]:     </interface>
Aug 26 17:48:42 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:48:42 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871/console.log" append="off"/>
Aug 26 17:48:42 user nova-compute[73110]:     </serial>
Aug 26 17:48:42 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:48:42 user nova-compute[73110]:     <video>
Aug 26 17:48:42 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:48:42 user nova-compute[73110]:     </video>
Aug 26 17:48:42 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:48:42 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:48:42 user nova-compute[73110]:     </rng>
Aug 26 17:48:42 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:48:42 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:48:42 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:48:42 user nova-compute[73110]:     </memballoon>
Aug 26 17:48:42 user nova-compute[73110]:   </devices>
Aug 26 17:48:42 user nova-compute[73110]: </domain>
Aug 26 17:48:42 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1405059155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG os_vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1dd4f93-8b, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1dd4f93-8b, col_values=(('external_ids', {'iface-id': 'd1dd4f93-8bf7-474d-a10c-aa26b1c28ab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:9b:41', 'vm-uuid': '2faed1ff-2bc7-4e0e-8034-4a893fd82871'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:42 user nova-compute[73110]: INFO os_vif [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b')
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:48:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] No VIF found with MAC fa:16:3e:eb:9b:41, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:44 user nova-compute[73110]: WARNING nova.compute.manager [req-597d80fc-c3ae-47ba-b3b1-7f8459e3733d req-8e5944a4-b808-41ae-99ff-0017902eb807 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 17:48:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072126.5454736, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:46 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Resumed (Lifecycle Event)
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:48:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance spawned successfully.
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:48:46 user nova-compute[73110]: WARNING nova.compute.manager [req-f3ab376d-dd71-4881-877f-9a151ad1e08d req-3c78488b-f212-45cc-afb7-be2c7af56ef3 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:46 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072126.5521905, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:48:46 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Started (Lifecycle Event)
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:48:46 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73110) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 17:48:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a1de951-e6f0-45c8-a9a7-abcce9943e87 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.097s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:48:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [{"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-7a5294e5-ba09-49bd-b78a-33ebc306d925" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:48:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:48:57 user nova-compute[73110]: INFO nova.compute.manager [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Detaching volume 37d4ad88-7329-4b25-bc68-8bc19e686c7c
Aug 26 17:48:58 user nova-compute[73110]: INFO nova.virt.block_device [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attempting to driver detach volume 37d4ad88-7329-4b25-bc68-8bc19e686c7c from mountpoint /dev/vdb
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Attempting to detach device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:48:58 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:48:58 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 17:48:58 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:48:58 user nova-compute[73110]:   <serial>37d4ad88-7329-4b25-bc68-8bc19e686c7c</serial>
Aug 26 17:48:58 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:48:58 user nova-compute[73110]: </disk>
Aug 26 17:48:58 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:48:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config.
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:48:58 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:48:58 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 17:48:58 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:48:58 user nova-compute[73110]:   <serial>37d4ad88-7329-4b25-bc68-8bc19e686c7c</serial>
Aug 26 17:48:58 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:48:58 user nova-compute[73110]: </disk>
Aug 26 17:48:58 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072138.5771563, f7c61d60-b862-475f-84cd-bf03501890b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:48:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config.
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqePjkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:48:58 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aca8497-88d2-4eca-939d-5d28207b72f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccecc4f2-42ef-48a7-8d77-faec6af8c907]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c (non-flash)
Aug 26 17:48:58 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:48:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd573c05090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c49df3-ee34-423f-8167-4b411e298e75]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8ada3-6fdd-4086-ae65-010afea7dab3]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f51f83-db0c-467a-a8b8-88b82399cc6d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0cecf-a4e0-495f-b693-32607ce7a21a]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386b5da-53c5-4f83-9153-7edcbd1ef399]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cba6cd-122b-4f4b-b753-1b385e37eda6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260]
Aug 26 17:48:58 user nova-compute[73110]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c, portal: 172.16.0.220,3260] successful.
Aug 26 17:48:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4ad88-7329-4b25-bc68-8bc19e686c7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc9c43e-66bf-4582-9afd-0a8087ce2dbb]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== disconnect_volume: return (388ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:48:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8a98399-e6ea-4996-98be-f4e134aacb43 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.958s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:48:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:49:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:49:01 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:01 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.43292236328125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7a5294e5-ba09-49bd-b78a-33ebc306d925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 84d42b86-03a9-496c-85bd-e643ea8ab023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2faed1ff-2bc7-4e0e-8034-4a893fd82871 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7a5300c-1631-4054-b657-f07ce5f8b3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:01 user nova-compute[73110]: INFO nova.compute.manager [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Detaching volume cb2518f8-4972-432e-82ef-333bf17b9db0
Aug 26 17:49:01 user nova-compute[73110]: INFO nova.virt.block_device [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Attempting to driver detach volume cb2518f8-4972-432e-82ef-333bf17b9db0 from mountpoint /dev/vdb
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Attempting to detach device vdb from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:49:01 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:49:01 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:49:01 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:49:01 user nova-compute[73110]:   <serial>cb2518f8-4972-432e-82ef-333bf17b9db0</serial>
Aug 26 17:49:01 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:49:01 user nova-compute[73110]: </disk>
Aug 26 17:49:01 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:49:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully detached device vdb from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the persistent domain config.
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:49:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:49:01 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:49:01 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:49:01 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:49:01 user nova-compute[73110]:   <serial>cb2518f8-4972-432e-82ef-333bf17b9db0</serial>
Aug 26 17:49:01 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:49:01 user nova-compute[73110]: </disk>
Aug 26 17:49:01 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072142.3381, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:49:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully detached device vdb from instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 from the live domain config.
Aug 26 17:49:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TemvPLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9db3c04-1462-4c60-ba37-c28be1620c8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[20761057-eaef-4838-be37-3450a28fdbb4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:02 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54461d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc34b4ea-fe59-40f9-bd19-0b66722e19ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5773873-e058-4b01-9b9c-5382ef1e892d]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0bed7-cf3d-4ab4-99c9-bcfe53a65387]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d06ee1-dd1e-420d-8e28-2021b0486b1f]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1260ad0f-f738-4b54-adf1-0b9a1fc7f961]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637913b-6379-4e34-990e-ad0e79784c6d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260]
Aug 26 17:49:02 user nova-compute[73110]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0, portal: 172.16.0.220,3260] successful.
Aug 26 17:49:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2518f8-4972-432e-82ef-333bf17b9db0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f999f-51e3-4032-a16b-88f793a8a7ef]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== disconnect_volume: return (389ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:49:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'flavor' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ef139b7-374f-48ed-ab79-d15d858ea60a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.944s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:08 user nova-compute[73110]: INFO nova.compute.manager [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Unshelving
Aug 26 17:49:08 user nova-compute[73110]: INFO nova.virt.block_device [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Booting with volume 351720c5-433e-486b-ae35-850feb7d0b52 at /dev/vdc
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840dfbf-d1bc-4fa0-84b4-37652e4cf940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2782f7-de3a-4055-8272-db07f3e5a24f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3294763-7f5b-47c9-b1c4-b07d37a5f9b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ea674-7ca5-4bae-a563-8c25026579e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:49:08 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:49:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d8e703-4aeb-4955-a816-668ed140016d]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG os_brick.utils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:08 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating existing volume attachment record: 0a0aca9c-45a4-4492-9461-31b5a6ff3930 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:49:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:10 user nova-compute[73110]: INFO nova.compute.manager [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Terminating instance
Aug 26 17:49:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-b40b27cf-3774-4b98-bb33-c641f81a60a3 req-590d83d8-87a0-456c-9343-8f9d8c6a06aa service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-unplugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Instance destroyed successfully.
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lazy-loading 'resources' on Instance uuid 84d42b86-03a9-496c-85bd-e643ea8ab023 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-332987352',display_name='tempest-ServerActionsTestOtherB-server-332987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-332987352',id=3,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl0A/6vymoLpfDG5q/6341a2VsH/WEK3Jmx9lAbHeWiC2s67RLojcQmPmGvb8xkWfJwOrLUcGs17aJMJl5vfLwVqhWQSxEij8jekHUnN7JTNxxxPXNQAZUOTh3kdCt+ig==',key_name='tempest-keypair-721629330',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aed9258ba923464ba423b3b9751f56cc',ramdisk_id='',reservation_id='r-1vzimq1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-453496732',owner_user_name='tempest-ServerActionsTestOtherB-453496732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72e7c15b85554d30915b4957791d2d54',uuid=84d42b86-03a9-496c-85bd-e643ea8ab023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converting VIF {"id": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "address": "fa:16:3e:58:9f:3c", "network": {"id": "2de63a27-7082-4a40-af6c-07ec6028d974", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1186087000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aed9258ba923464ba423b3b9751f56cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc99d4df-9d", "ovs_interfaceid": "bc99d4df-9d70-45f8-ba11-6965e6f146dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_vif [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc99d4df-9d, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:11 user nova-compute[73110]: INFO os_vif [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:9f:3c,bridge_name='br-int',has_traffic_filtering=True,id=bc99d4df-9d70-45f8-ba11-6965e6f146dc,network=Network(2de63a27-7082-4a40-af6c-07ec6028d974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc99d4df-9d')
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OknhLjMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7797920-7b66-4c96-9d30-728ef40b5a6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb044c-3016-44cd-8af1-712fd7d5b9df]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:49:11 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:11 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 (non-flash)
Aug 26 17:49:11 user nova-compute[73110]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:11 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5446d0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16'): ({'sdh'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Removing single pathed devices sdh {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[930b03de-3cf7-48d7-bbeb-6e4dffb915c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cccf31-c472-48c9-9d27-8eec822534d1]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Flushing IO for device /dev/sdh {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[51810b15-f270-4327-b0f9-edd5be0e995f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9867d3f-6e25-4f6c-b591-1292aee868dc]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] SCSI volumes sdh have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb3521-a1e9-4a7b-8cd3-04bded0ba5b0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed00f8f-432e-414e-9a77-ab1a77ac0164]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260]
Aug 26 17:49:11 user nova-compute[73110]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16, portal: 172.16.0.220,3260] successful.
Aug 26 17:49:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61dd01de-405d-4b62-bd9f-096e972d7e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[faadc580-a218-4923-aebc-dc2c2f230a3e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] <== disconnect_volume: return (294ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:49:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Deleting instance files /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_del
Aug 26 17:49:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Deletion of /opt/stack/data/nova/instances/84d42b86-03a9-496c-85bd-e643ea8ab023_del complete
Aug 26 17:49:11 user nova-compute[73110]: INFO nova.compute.manager [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 26 17:49:11 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:49:11 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:49:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] Acquiring lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] No waiting events found dispatching network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:13 user nova-compute[73110]: WARNING nova.compute.manager [req-7167986f-f24a-41c8-83ef-343a4c8b503d req-e77f7020-3946-47eb-ab11-5d01449373ff service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received unexpected event network-vif-plugged-bc99d4df-9d70-45f8-ba11-6965e6f146dc for instance with vm_state active and task_state deleting.
Aug 26 17:49:13 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:13 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Took 1.71 seconds to deallocate network for instance.
Aug 26 17:49:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:14 user nova-compute[73110]: INFO nova.compute.manager [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Took 0.88 seconds to detach 1 volumes for instance.
Aug 26 17:49:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:14 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:14 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:14 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Deleted allocations for instance 84d42b86-03a9-496c-85bd-e643ea8ab023
Aug 26 17:49:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c80dd938-7ab5-4c58-9745-11c4772083a3 tempest-ServerActionsTestOtherB-453496732 tempest-ServerActionsTestOtherB-453496732-project-member] Lock "84d42b86-03a9-496c-85bd-e643ea8ab023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.399s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-40e5e702-0c85-43e2-a90e-02c4de98e9ff req-35911996-241f-4238-bba0-b806b3a174a5 service nova] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Received event network-vif-deleted-bc99d4df-9d70-45f8-ba11-6965e6f146dc {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_requests' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'numa_topology' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:49:20 user nova-compute[73110]: INFO nova.compute.claims [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Claim successful on node user
Aug 26 17:49:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:21 user nova-compute[73110]: INFO nova.network.neutron [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating port 022f585c-5ca8-414c-b0cd-59c98b2f1254 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:49:21 user nova-compute[73110]: INFO nova.compute.claims [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Claim successful on node user
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing instance network info cache due to event network-changed-022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:49:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.policy [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '095465fef30b4fd0a144cb5b7c4ffb7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef6ddc676bd48e4886079097e3e0d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:49:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Creating image(s)
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:49:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Creating image(s)
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'trusted_certs' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Refreshing network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG nova.objects.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e277fb69-1fba-42da-98f6-7b55b892788e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "6743389174b22b78fb51f1f562da4de6e2628ac1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "6743389174b22b78fb51f1f562da4de6e2628ac1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Successfully created port: c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 1.380s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.part --force-share --output=json" returned: 0 in 0.222s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.virt.images [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] 93103acd-f9be-48cc-a677-40958464dd71 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.part /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.221s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk 1073741824" returned: 0 in 0.088s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updated VIF entry in instance network info cache for port 022f585c-5ca8-414c-b0cd-59c98b2f1254. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9ddf21-1491-4a69-b24e-63517e94d213 req-83dcd9ea-2055-4944-8eb5-2ac21809ec80 service nova] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.294s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.part /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.converted" returned: 0 in 0.596s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Cannot resize image /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Ensure instance console log exists: /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "6743389174b22b78fb51f1f562da4de6e2628ac1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.289s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Successfully updated port: c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-changed-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Refreshing instance network info cache due to event network-changed-c5495262-75f5-4825-920f-72bd07c29452. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:49:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] Acquiring lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json" returned: 0 in 0.232s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "6743389174b22b78fb51f1f562da4de6e2628ac1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "6743389174b22b78fb51f1f562da4de6e2628ac1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1,backing_fmt=raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1,backing_fmt=raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk 1073741824" returned: 0 in 0.053s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "6743389174b22b78fb51f1f562da4de6e2628ac1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Instance network_info: |[{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] Acquired lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.neutron [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Refreshing network info cache for port c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Start _get_guest_xml network_info=[{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:49:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-518157684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-518157684',id=21,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-g7xkk2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:22Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=a2a92241-07a2-43d9-aceb-98fc7f81fc8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 --force-share --output=json" returned: 0 in 0.234s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'migration_context' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:49:25 user nova-compute[73110]:   <uuid>a2a92241-07a2-43d9-aceb-98fc7f81fc8d</uuid>
Aug 26 17:49:25 user nova-compute[73110]:   <name>instance-00000015</name>
Aug 26 17:49:25 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:49:25 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:49:25 user nova-compute[73110]:   <metadata>
Aug 26 17:49:25 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:49:25 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-518157684</nova:name>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:49:25</nova:creationTime>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:49:25 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:49:25 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:owner>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 17:49:25 user nova-compute[73110]:       </nova:owner>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:49:25 user nova-compute[73110]:       <nova:ports>
Aug 26 17:49:25 user nova-compute[73110]:         <nova:port uuid="c5495262-75f5-4825-920f-72bd07c29452">
Aug 26 17:49:25 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 17:49:25 user nova-compute[73110]:         </nova:port>
Aug 26 17:49:25 user nova-compute[73110]:       </nova:ports>
Aug 26 17:49:25 user nova-compute[73110]:     </nova:instance>
Aug 26 17:49:25 user nova-compute[73110]:   </metadata>
Aug 26 17:49:25 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:49:25 user nova-compute[73110]:     <system>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="serial">a2a92241-07a2-43d9-aceb-98fc7f81fc8d</entry>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="uuid">a2a92241-07a2-43d9-aceb-98fc7f81fc8d</entry>
Aug 26 17:49:25 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:49:25 user nova-compute[73110]:     </system>
Aug 26 17:49:25 user nova-compute[73110]:   </sysinfo>
Aug 26 17:49:25 user nova-compute[73110]:   <os>
Aug 26 17:49:25 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:49:25 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:49:25 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:49:25 user nova-compute[73110]:   </os>
Aug 26 17:49:25 user nova-compute[73110]:   <features>
Aug 26 17:49:25 user nova-compute[73110]:     <acpi/>
Aug 26 17:49:25 user nova-compute[73110]:     <apic/>
Aug 26 17:49:25 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:49:25 user nova-compute[73110]:   </features>
Aug 26 17:49:25 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:49:25 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:49:25 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:49:25 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:49:25 user nova-compute[73110]:   </clock>
Aug 26 17:49:25 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:49:25 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:49:25 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:49:25 user nova-compute[73110]:   </cpu>
Aug 26 17:49:25 user nova-compute[73110]:   <devices>
Aug 26 17:49:25 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:49:25 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:49:25 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk"/>
Aug 26 17:49:25 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:49:25 user nova-compute[73110]:     </disk>
Aug 26 17:49:25 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:49:25 user nova-compute[73110]:       <mac address="fa:16:3e:c9:ed:ea"/>
Aug 26 17:49:25 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:25 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:49:25 user nova-compute[73110]:       <target dev="tapc5495262-75"/>
Aug 26 17:49:25 user nova-compute[73110]:     </interface>
Aug 26 17:49:25 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:49:25 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/console.log" append="off"/>
Aug 26 17:49:25 user nova-compute[73110]:     </serial>
Aug 26 17:49:25 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:49:25 user nova-compute[73110]:     <video>
Aug 26 17:49:25 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:25 user nova-compute[73110]:     </video>
Aug 26 17:49:25 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:49:25 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:49:25 user nova-compute[73110]:     </rng>
Aug 26 17:49:25 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:49:25 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:49:25 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:49:25 user nova-compute[73110]:     </memballoon>
Aug 26 17:49:25 user nova-compute[73110]:   </devices>
Aug 26 17:49:25 user nova-compute[73110]: </domain>
Aug 26 17:49:25 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-518157684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-518157684',id=21,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-g7xkk2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:22Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=a2a92241-07a2-43d9-aceb-98fc7f81fc8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG os_vif [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.objects.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e277fb69-1fba-42da-98f6-7b55b892788e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:49:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Rebasing disk image.
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5495262-75, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5495262-75, col_values=(('external_ids', {'iface-id': 'c5495262-75f5-4825-920f-72bd07c29452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:ed:ea', 'vm-uuid': 'a2a92241-07a2-43d9-aceb-98fc7f81fc8d'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:25 user nova-compute[73110]: INFO os_vif [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75')
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd -F raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:49:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:c9:ed:ea, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:49:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updated VIF entry in instance network info cache for port c5495262-75f5-4825-920f-72bd07c29452. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:49:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-084e09a1-2264-4a57-ad71-b5ecfa8a4084 req-cdd0a4d5-16c4-40e8-bd97-f3489e7f7b94 service nova] Releasing lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:26 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072151.4638326, 84d42b86-03a9-496c-85bd-e643ea8ab023 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:26 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] VM Stopped (Lifecycle Event)
Aug 26 17:49:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2c9f922a-226d-4446-ad41-41cad0bb4770 None None] [instance: 84d42b86-03a9-496c-85bd-e643ea8ab023] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:27 user nova-compute[73110]: WARNING nova.compute.manager [req-45ee0456-a976-48eb-ac53-49597b134fcd req-3c9df565-f170-4374-bd1f-7086f222313c service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state building and task_state spawning.
Aug 26 17:49:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd -F raw /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk" returned: 0 in 2.389s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Ensure instance console log exists: /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start _get_guest_xml network_info=[{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fc82e7c2edb57d44776e1f5d295f8066',container_format='bare',created_at=2023-08-26T17:47:15Z,direct_url=<?>,disk_format='qcow2',id=93103acd-f9be-48cc-a677-40958464dd71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2001790373-shelved',owner='8b35bd237a204d0c9f8d3dffbc755653',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T17:47:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0a0aca9c-45a4-4492-9461-31b5a6ff3930', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFuWGPUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e277fb69-1fba-42da-98f6-7b55b892788e', 'attached_at': '', 'detached_at': '', 'volume_id': '351720c5-433e-486b-ae35-850feb7d0b52', 'serial': '351720c5-433e-486b-ae35-850feb7d0b52'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:49:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fc82e7c2edb57d44776e1f5d295f8066',container_format='bare',created_at=2023-08-26T17:47:15Z,direct_url=<?>,disk_format='qcow2',id=93103acd-f9be-48cc-a677-40958464dd71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2001790373-shelved',owner='8b35bd237a204d0c9f8d3dffbc755653',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T17:47:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'vcpu_model' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.objects.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e277fb69-1fba-42da-98f6-7b55b892788e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFuWGPUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:28 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:49:28 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:49:28 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d3773-6861-465d-b6e4-9dc32c029b30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:49:28 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[911cb1b1-2ebf-4635-8336-3692ad4a22b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52] added
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[02142d2d-0400-4062-8fea-45e3283efe49]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79cb08-76f4-4a57-b157-614a256b773f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFuWGPUr {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFuWGPUr" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd97d0-871f-4d26-8b02-09f6d5651663]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFuWGPUr'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268c3ef-8cb3-4cc2-8c9f-70352d025470]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94935f0-c63d-4b37-a321-34927d4096f2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[06410eb8-f8af-4da7-992d-0c9da33c59a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260]
Aug 26 17:49:28 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260] successful.
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1cc40d-a286-4265-b619-86fb71e6d481]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[613fd4a7-a543-42dc-b982-7f20e60068fc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:49:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fbcddf-5809-404a-a1b6-556111128f88]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:49:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFuWGPUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26231316430653733', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231316430653733', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:29 user nova-compute[73110]: WARNING nova.compute.manager [req-ab614a0e-866e-4c5f-a2c3-71953e8a196f req-96411a45-1389-49e2-b676-1bac69b8ffb0 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state building and task_state spawning.
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='93103acd-f9be-48cc-a677-40958464dd71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1356496581',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:47:19.308858',shelved_host='user',shelved_image_id='93103acd-f9be-48cc-a677-40958464dd71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.objects.instance [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_devices' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.objects.base [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e277fb69-1fba-42da-98f6-7b55b892788e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:49:29 user nova-compute[73110]:   <uuid>e277fb69-1fba-42da-98f6-7b55b892788e</uuid>
Aug 26 17:49:29 user nova-compute[73110]:   <name>instance-0000000f</name>
Aug 26 17:49:29 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:49:29 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:49:29 user nova-compute[73110]:   <metadata>
Aug 26 17:49:29 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:49:29 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2001790373</nova:name>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:49:28</nova:creationTime>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:49:29 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:49:29 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:owner>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:user uuid="a4f2d956017b4782a5db5b60ff5106d1">tempest-AttachVolumeShelveTestJSON-90237160-project-member</nova:user>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:project uuid="8b35bd237a204d0c9f8d3dffbc755653">tempest-AttachVolumeShelveTestJSON-90237160</nova:project>
Aug 26 17:49:29 user nova-compute[73110]:       </nova:owner>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:root type="image" uuid="93103acd-f9be-48cc-a677-40958464dd71"/>
Aug 26 17:49:29 user nova-compute[73110]:       <nova:ports>
Aug 26 17:49:29 user nova-compute[73110]:         <nova:port uuid="022f585c-5ca8-414c-b0cd-59c98b2f1254">
Aug 26 17:49:29 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 17:49:29 user nova-compute[73110]:         </nova:port>
Aug 26 17:49:29 user nova-compute[73110]:       </nova:ports>
Aug 26 17:49:29 user nova-compute[73110]:     </nova:instance>
Aug 26 17:49:29 user nova-compute[73110]:   </metadata>
Aug 26 17:49:29 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:49:29 user nova-compute[73110]:     <system>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="serial">e277fb69-1fba-42da-98f6-7b55b892788e</entry>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="uuid">e277fb69-1fba-42da-98f6-7b55b892788e</entry>
Aug 26 17:49:29 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:49:29 user nova-compute[73110]:     </system>
Aug 26 17:49:29 user nova-compute[73110]:   </sysinfo>
Aug 26 17:49:29 user nova-compute[73110]:   <os>
Aug 26 17:49:29 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:49:29 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:49:29 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:49:29 user nova-compute[73110]:   </os>
Aug 26 17:49:29 user nova-compute[73110]:   <features>
Aug 26 17:49:29 user nova-compute[73110]:     <acpi/>
Aug 26 17:49:29 user nova-compute[73110]:     <apic/>
Aug 26 17:49:29 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:49:29 user nova-compute[73110]:   </features>
Aug 26 17:49:29 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:49:29 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:49:29 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:49:29 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:49:29 user nova-compute[73110]:   </clock>
Aug 26 17:49:29 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:49:29 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:49:29 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:49:29 user nova-compute[73110]:   </cpu>
Aug 26 17:49:29 user nova-compute[73110]:   <devices>
Aug 26 17:49:29 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:49:29 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:49:29 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk"/>
Aug 26 17:49:29 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:49:29 user nova-compute[73110]:     </disk>
Aug 26 17:49:29 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:49:29 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:49:29 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 17:49:29 user nova-compute[73110]:       <target dev="vdc" bus="virtio"/>
Aug 26 17:49:29 user nova-compute[73110]:       <serial>351720c5-433e-486b-ae35-850feb7d0b52</serial>
Aug 26 17:49:29 user nova-compute[73110]:     </disk>
Aug 26 17:49:29 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:49:29 user nova-compute[73110]:       <mac address="fa:16:3e:9c:62:e1"/>
Aug 26 17:49:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:29 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:49:29 user nova-compute[73110]:       <target dev="tap022f585c-5c"/>
Aug 26 17:49:29 user nova-compute[73110]:     </interface>
Aug 26 17:49:29 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:49:29 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/console.log" append="off"/>
Aug 26 17:49:29 user nova-compute[73110]:     </serial>
Aug 26 17:49:29 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:49:29 user nova-compute[73110]:     <video>
Aug 26 17:49:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:29 user nova-compute[73110]:     </video>
Aug 26 17:49:29 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:49:29 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:49:29 user nova-compute[73110]:     </rng>
Aug 26 17:49:29 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:49:29 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:49:29 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:49:29 user nova-compute[73110]:     </memballoon>
Aug 26 17:49:29 user nova-compute[73110]:   </devices>
Aug 26 17:49:29 user nova-compute[73110]: </domain>
Aug 26 17:49:29 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='93103acd-f9be-48cc-a677-40958464dd71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1356496581',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:47:19.308858',shelved_host='user',shelved_image_id='93103acd-f9be-48cc-a677-40958464dd71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG os_vif [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap022f585c-5c, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap022f585c-5c, col_values=(('external_ids', {'iface-id': '022f585c-5ca8-414c-b0cd-59c98b2f1254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:62:e1', 'vm-uuid': 'e277fb69-1fba-42da-98f6-7b55b892788e'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:29 user nova-compute[73110]: INFO os_vif [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c')
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072169.7236602, a2a92241-07a2-43d9-aceb-98fc7f81fc8d => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] VM Resumed (Lifecycle Event)
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Instance spawned successfully.
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No VIF found with MAC fa:16:3e:9c:62:e1, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072169.7288592, a2a92241-07a2-43d9-aceb-98fc7f81fc8d => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] VM Started (Lifecycle Event)
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 26 17:49:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:29 user nova-compute[73110]: INFO nova.compute.manager [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Took 8.20 seconds to build instance.
Aug 26 17:49:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-51f4d92a-108f-4588-8e9a-8470af74c60c tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.316s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:31 user nova-compute[73110]: WARNING nova.compute.manager [req-adf22671-ef56-41cd-952f-079b17d65421 req-dbc0ac1f-7a90-451a-9ca7-4b09b0a35636 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-changed-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Refreshing instance network info cache due to event network-changed-8866d19d-f9b2-4e1c-9931-d575659cd38b. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] Acquiring lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] Acquired lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Refreshing network info cache for port 8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:32 user nova-compute[73110]: INFO nova.compute.manager [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Terminating instance
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-248e281a-8390-4c1e-8142-f5dbd8743f85 req-60324c72-f0a5-4d40-8338-6cc703ed1c4c service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updated VIF entry in instance network info cache for port 8866d19d-f9b2-4e1c-9931-d575659cd38b. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.network.neutron [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updating instance_info_cache with network_info: [{"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Instance destroyed successfully.
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'resources' on Instance uuid d7a5300c-1631-4054-b657-f07ce5f8b3b6 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1a639fe5-a699-4a68-9dc2-7658bbe5fc0d req-637044e3-b201-4fcb-87f1-5229071c7815 service nova] Releasing lock "refresh_cache-d7a5300c-1631-4054-b657-f07ce5f8b3b6" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914866531',display_name='tempest-AttachVolumeNegativeTest-server-1914866531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914866531',id=19,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh+tEZeGSy9XuzqqfgzYfZlkyXEcJ8o1aLt1Xa1jSIH+PCztadCxGRGyAqR55EsdDV0CK7vAr6c7Ns0566Yd6Huwak3rYiIy7WbE4UvkwlaKNbuTvR4jtYscx2DVIkBlA==',key_name='tempest-keypair-429359922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-kffywfxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=d7a5300c-1631-4054-b657-f07ce5f8b3b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "address": "fa:16:3e:9b:e1:57", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8866d19d-f9", "ovs_interfaceid": "8866d19d-f9b2-4e1c-9931-d575659cd38b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG os_vif [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8866d19d-f9, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:33 user nova-compute[73110]: INFO os_vif [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e1:57,bridge_name='br-int',has_traffic_filtering=True,id=8866d19d-f9b2-4e1c-9931-d575659cd38b,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8866d19d-f9')
Aug 26 17:49:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Deleting instance files /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6_del
Aug 26 17:49:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Deletion of /opt/stack/data/nova/instances/d7a5300c-1631-4054-b657-f07ce5f8b3b6_del complete
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: INFO nova.compute.manager [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 17:49:33 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:33 user nova-compute[73110]: WARNING nova.compute.manager [req-59deae07-951a-461b-913e-4becd6ae3c27 req-9df85137-3d66-4517-a476-e0a15c22b2f8 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 17:49:33 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072173.9972014, e277fb69-1fba-42da-98f6-7b55b892788e => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Resumed (Lifecycle Event)
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance spawned successfully.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072173.9992642, e277fb69-1fba-42da-98f6-7b55b892788e => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Started (Lifecycle Event)
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Took 1.02 seconds to deallocate network for instance.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-70f23d73-0a78-4e54-ba28-c03536fac9fa req-4c096ce9-33ad-4f2f-97c1-c247b12a17d5 service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-deleted-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-955844bb-8fc2-4a18-b621-3a7ad43af05c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.208s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Deleted allocations for instance d7a5300c-1631-4054-b657-f07ce5f8b3b6
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:34 user nova-compute[73110]: WARNING nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state deleted and task_state None.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:34 user nova-compute[73110]: WARNING nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state deleted and task_state None.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:34 user nova-compute[73110]: WARNING nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state deleted and task_state None.
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:34 user nova-compute[73110]: WARNING nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-unplugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state deleted and task_state None.
Aug 26 17:49:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Acquiring lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] No waiting events found dispatching network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:35 user nova-compute[73110]: WARNING nova.compute.manager [req-90dfc2b2-a6bd-4993-8770-bdf19ea0c5d7 req-a1f06ec7-2200-4174-8804-2be468118dae service nova] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Received unexpected event network-vif-plugged-8866d19d-f9b2-4e1c-9931-d575659cd38b for instance with vm_state deleted and task_state None.
Aug 26 17:49:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6a6619bf-e1a6-4d0e-afe5-eedcd2b81da8 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "d7a5300c-1631-4054-b657-f07ce5f8b3b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:49:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:49:45 user nova-compute[73110]: INFO nova.compute.claims [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Claim successful on node user
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:49:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:49:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.policy [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d8f33fb4e7447d4b696e89192fc3a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e8e8d866a04e429135ef1baa0059f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:49:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Creating image(s)
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "/opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "/opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "/opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.209s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk 1073741824" returned: 0 in 0.068s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Successfully created port: f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:49:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Cannot resize image /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Ensure instance console log exists: /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Successfully updated port: f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquired lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-changed-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Refreshing instance network info cache due to event network-changed-f8ada419-a655-4bbd-af84-f7085cf103b6. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] Acquiring lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:47 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072173.1434238, d7a5300c-1631-4054-b657-f07ce5f8b3b6 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:48 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] VM Stopped (Lifecycle Event)
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d7e00c5-a5e2-42a5-bc7d-704f562dbac4 None None] [instance: d7a5300c-1631-4054-b657-f07ce5f8b3b6] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Updating instance_info_cache with network_info: [{"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Releasing lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Instance network_info: |[{"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] Acquired lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Refreshing network info cache for port f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Start _get_guest_xml network_info=[{"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:49:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490761801',display_name='tempest-ServersNegativeTestJSON-server-1490761801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490761801',id=22,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-l0054p3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:46Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=db7fad40-12ca-494e-a6e6-f47dd66890c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lazy-loading 'pci_devices' on Instance uuid db7fad40-12ca-494e-a6e6-f47dd66890c2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:49:48 user nova-compute[73110]:   <uuid>db7fad40-12ca-494e-a6e6-f47dd66890c2</uuid>
Aug 26 17:49:48 user nova-compute[73110]:   <name>instance-00000016</name>
Aug 26 17:49:48 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:49:48 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:49:48 user nova-compute[73110]:   <metadata>
Aug 26 17:49:48 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:49:48 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:name>tempest-ServersNegativeTestJSON-server-1490761801</nova:name>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:49:48</nova:creationTime>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:49:48 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:49:48 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:owner>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:user uuid="8d8f33fb4e7447d4b696e89192fc3a3e">tempest-ServersNegativeTestJSON-794179261-project-member</nova:user>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:project uuid="18e8e8d866a04e429135ef1baa0059f0">tempest-ServersNegativeTestJSON-794179261</nova:project>
Aug 26 17:49:48 user nova-compute[73110]:       </nova:owner>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:49:48 user nova-compute[73110]:       <nova:ports>
Aug 26 17:49:48 user nova-compute[73110]:         <nova:port uuid="f8ada419-a655-4bbd-af84-f7085cf103b6">
Aug 26 17:49:48 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:49:48 user nova-compute[73110]:         </nova:port>
Aug 26 17:49:48 user nova-compute[73110]:       </nova:ports>
Aug 26 17:49:48 user nova-compute[73110]:     </nova:instance>
Aug 26 17:49:48 user nova-compute[73110]:   </metadata>
Aug 26 17:49:48 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:49:48 user nova-compute[73110]:     <system>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="serial">db7fad40-12ca-494e-a6e6-f47dd66890c2</entry>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="uuid">db7fad40-12ca-494e-a6e6-f47dd66890c2</entry>
Aug 26 17:49:48 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:49:48 user nova-compute[73110]:     </system>
Aug 26 17:49:48 user nova-compute[73110]:   </sysinfo>
Aug 26 17:49:48 user nova-compute[73110]:   <os>
Aug 26 17:49:48 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:49:48 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:49:48 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:49:48 user nova-compute[73110]:   </os>
Aug 26 17:49:48 user nova-compute[73110]:   <features>
Aug 26 17:49:48 user nova-compute[73110]:     <acpi/>
Aug 26 17:49:48 user nova-compute[73110]:     <apic/>
Aug 26 17:49:48 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:49:48 user nova-compute[73110]:   </features>
Aug 26 17:49:48 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:49:48 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:49:48 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:49:48 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:49:48 user nova-compute[73110]:   </clock>
Aug 26 17:49:48 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:49:48 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:49:48 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:49:48 user nova-compute[73110]:   </cpu>
Aug 26 17:49:48 user nova-compute[73110]:   <devices>
Aug 26 17:49:48 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:49:48 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:49:48 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk"/>
Aug 26 17:49:48 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:49:48 user nova-compute[73110]:     </disk>
Aug 26 17:49:48 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:49:48 user nova-compute[73110]:       <mac address="fa:16:3e:24:6a:f1"/>
Aug 26 17:49:48 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:48 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:49:48 user nova-compute[73110]:       <target dev="tapf8ada419-a6"/>
Aug 26 17:49:48 user nova-compute[73110]:     </interface>
Aug 26 17:49:48 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:49:48 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/console.log" append="off"/>
Aug 26 17:49:48 user nova-compute[73110]:     </serial>
Aug 26 17:49:48 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:49:48 user nova-compute[73110]:     <video>
Aug 26 17:49:48 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:49:48 user nova-compute[73110]:     </video>
Aug 26 17:49:48 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:49:48 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:49:48 user nova-compute[73110]:     </rng>
Aug 26 17:49:48 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:49:48 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:49:48 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:49:48 user nova-compute[73110]:     </memballoon>
Aug 26 17:49:48 user nova-compute[73110]:   </devices>
Aug 26 17:49:48 user nova-compute[73110]: </domain>
Aug 26 17:49:48 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490761801',display_name='tempest-ServersNegativeTestJSON-server-1490761801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490761801',id=22,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-l0054p3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:49:46Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=db7fad40-12ca-494e-a6e6-f47dd66890c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG os_vif [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8ada419-a6, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8ada419-a6, col_values=(('external_ids', {'iface-id': 'f8ada419-a655-4bbd-af84-f7085cf103b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:6a:f1', 'vm-uuid': 'db7fad40-12ca-494e-a6e6-f47dd66890c2'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:48 user nova-compute[73110]: INFO os_vif [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6')
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] No VIF found with MAC fa:16:3e:24:6a:f1, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Updated VIF entry in instance network info cache for port f8ada419-a655-4bbd-af84-f7085cf103b6. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Updating instance_info_cache with network_info: [{"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-458510bb-71e4-48c8-9e29-54d6962eb88b req-5b714451-56e3-47df-80a1-6963271c33bc service nova] Releasing lock "refresh_cache-db7fad40-12ca-494e-a6e6-f47dd66890c2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] No waiting events found dispatching network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:50 user nova-compute[73110]: WARNING nova.compute.manager [req-dec0b3bf-57f9-4754-a369-3be41a65fbbd req-4685795c-fbac-4c0f-9b95-08804a44b1bc service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received unexpected event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 for instance with vm_state building and task_state spawning.
Aug 26 17:49:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:51 user nova-compute[73110]: INFO nova.compute.manager [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Terminating instance
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-32f5eb1d-af6d-4dc4-9d56-19be9493e2a5 req-c007855f-bf12-437f-9277-c9e91dae2e62 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-unplugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Instance destroyed successfully.
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'resources' on Instance uuid 7a5294e5-ba09-49bd-b78a-33ebc306d925 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-934297327',display_name='tempest-AttachVolumeTestJSON-server-934297327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-934297327',id=5,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP69gRCHY00s10amKI0MaCRj3UAIo7UKxfEFkKzWXbeyRNMFFWHogkLFFLi1keYNTIP2ldjUYEJpW7ncO4T+ZeIVBbndKlqbhXQIzlNysUf3AURCuYLoTogY5tmw3y9zg==',key_name='tempest-keypair-126013612',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-ishyqdp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=7a5294e5-ba09-49bd-b78a-33ebc306d925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "address": "fa:16:3e:ee:a0:36", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf549c20-9f", "ovs_interfaceid": "df549c20-9f92-4f6a-8ba4-90a7ea5605d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG os_vif [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf549c20-9f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:51 user nova-compute[73110]: INFO os_vif [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=df549c20-9f92-4f6a-8ba4-90a7ea5605d0,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf549c20-9f')
Aug 26 17:49:51 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Deleting instance files /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925_del
Aug 26 17:49:51 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Deletion of /opt/stack/data/nova/instances/7a5294e5-ba09-49bd-b78a-33ebc306d925_del complete
Aug 26 17:49:51 user nova-compute[73110]: INFO nova.compute.manager [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 17:49:51 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:49:51 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Terminating instance
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Terminating instance
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] No waiting events found dispatching network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:52 user nova-compute[73110]: WARNING nova.compute.manager [req-9eb67ab0-dc48-4af8-9a80-c082b0731e27 req-a48d91ef-4966-4d66-b126-9f48d300ddfe service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received unexpected event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 for instance with vm_state building and task_state spawning.
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072192.460991, db7fad40-12ca-494e-a6e6-f47dd66890c2 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] VM Resumed (Lifecycle Event)
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Instance spawned successfully.
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072192.4610896, db7fad40-12ca-494e-a6e6-f47dd66890c2 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] VM Started (Lifecycle Event)
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 26 17:49:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: INFO nova.compute.manager [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Took 7.28 seconds to build instance.
Aug 26 17:49:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0601ffd2-0b3b-4743-9132-9d2ab4fbae20 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.405s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Instance destroyed successfully.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'resources' on Instance uuid 8662b876-8ed7-4b01-b28a-ce551b8d0097 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1752912019',display_name='tempest-ServerActionsTestOtherA-server-1112193447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1752912019',id=13,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6jJmxHlr+eOTS096gBRqdbjMmIEqSJTvmWRVT2F2sT+VQqCW+mWEA9vzKKd6vSqQXrk4JfvYwCGnnfjc/EVcF3lPc4pp7jj/IscNxx78/h1jD/LhnGm4Wm53FqNywULg==',key_name='tempest-keypair-1433103061',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-nlm84181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=8662b876-8ed7-4b01-b28a-ce551b8d0097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a045650c-7390-47e9-9a99-586c63fcd273", "address": "fa:16:3e:98:9c:ee", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa045650c-73", "ovs_interfaceid": "a045650c-7390-47e9-9a99-586c63fcd273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_vif [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa045650c-73, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Instance destroyed successfully.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.objects.instance [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lazy-loading 'resources' on Instance uuid 2faed1ff-2bc7-4e0e-8034-4a893fd82871 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: INFO os_vif [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9c:ee,bridge_name='br-int',has_traffic_filtering=True,id=a045650c-7390-47e9-9a99-586c63fcd273,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa045650c-73')
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Deleting instance files /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097_del
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Deletion of /opt/stack/data/nova/instances/8662b876-8ed7-4b01-b28a-ce551b8d0097_del complete
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1405059155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-728965317',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwsWbyfQid5D/aE+kgB92l+mqRGVeKzkrczLk12M2aTfkdy/iKctQc60n/+bQCIHN0JDWRAcGbx5aabYxAOvWQuLZDdbBWg9gdvmE+FbWtSY+M5fV10ARQgcuBmuIRvXw==',key_name='tempest-keypair-2062024474',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9a97610a2dc4c1c97890c6645883757',ramdisk_id='',reservation_id='r-i5rbblb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1105370441',owner_user_name='tempest-ServerActionsV293TestJSON-1105370441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f2fbfd19ab04e91a44dd5a1954f231d',uuid=2faed1ff-2bc7-4e0e-8034-4a893fd82871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converting VIF {"id": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "address": "fa:16:3e:eb:9b:41", "network": {"id": "4f45c871-cfdf-4c6e-9867-d596a2e2130b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1984623897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a97610a2dc4c1c97890c6645883757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1dd4f93-8b", "ovs_interfaceid": "d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_vif [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1dd4f93-8b, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:49:53 user nova-compute[73110]: INFO os_vif [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1,network=Network(4f45c871-cfdf-4c6e-9867-d596a2e2130b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1dd4f93-8b')
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dWLRhgrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:53 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e76cd6-9fb1-42ac-8558-51b4504f71b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.compute.manager [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af0c5f-96be-4600-8a2b-729d4bd58eb0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:53 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:53 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:49:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:49:53 user nova-compute[73110]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 (non-flash)
Aug 26 17:49:53 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:49:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520edf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70388182-9626-4f81-a370-9d839de7e171]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6e202-0edd-40b5-b7b0-0eb2e7314824]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c66dc3-bd76-406e-a882-69625c100d35]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26f9f4-44ee-45d5-987f-963e496d4469]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ee89bd-83db-4b33-a48e-c68b58761fab]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb23e5-f4b5-49fc-8a48-754e5c0bfb5d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260]
Aug 26 17:49:53 user nova-compute[73110]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8, portal: 172.16.0.220,3260] successful.
Aug 26 17:49:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Acquiring lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] No waiting events found dispatching network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:53 user nova-compute[73110]: WARNING nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received unexpected event network-vif-plugged-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 for instance with vm_state active and task_state deleting.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:53 user nova-compute[73110]: WARNING nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state deleting.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:53 user nova-compute[73110]: WARNING nova.compute.manager [req-6841d434-d0fc-4541-b9b9-b02c2901b9cd req-dd9f5e3f-5e6b-4930-954b-6897b533e9e4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state active and task_state deleting.
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53116ae7-3d6c-447d-9016-36fef4bab6d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6320ebb3-e27c-4738-a0b4-dcfff2ec5c9f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] <== disconnect_volume: return (493ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deleting instance files /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871_del
Aug 26 17:49:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deletion of /opt/stack/data/nova/instances/2faed1ff-2bc7-4e0e-8034-4a893fd82871_del complete
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:54 user nova-compute[73110]: INFO nova.compute.manager [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Took 1.76 seconds to destroy the instance on the hypervisor.
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:49:54 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Took 2.10 seconds to deallocate network for instance.
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-unplugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Acquiring lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] No waiting events found dispatching network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:54 user nova-compute[73110]: WARNING nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received unexpected event network-vif-plugged-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 for instance with vm_state active and task_state deleting.
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-635ade1b-ba31-42c8-90ac-5869db0fd345 req-78b02af9-6eef-4169-b8d8-69fe966d7d00 service nova] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Received event network-vif-deleted-df549c20-9f92-4f6a-8ba4-90a7ea5605d0 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:54 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Deleted allocations for instance 7a5294e5-ba09-49bd-b78a-33ebc306d925
Aug 26 17:49:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0216b6c2-8fcb-4457-9028-ba7f48291afc tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "7a5294e5-ba09-49bd-b78a-33ebc306d925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:55 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Took 1.55 seconds to deallocate network for instance.
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-7b9ba961-a67f-43b7-b840-b8bd78a7d290 req-89352ec2-eb85-445a-85c0-0075e59927c4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-deleted-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:55 user nova-compute[73110]: INFO nova.compute.manager [req-7b9ba961-a67f-43b7-b840-b8bd78a7d290 req-89352ec2-eb85-445a-85c0-0075e59927c4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Neutron deleted interface a045650c-7390-47e9-9a99-586c63fcd273; detaching it from the instance and deleting it from the info cache
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-7b9ba961-a67f-43b7-b840-b8bd78a7d290 req-89352ec2-eb85-445a-85c0-0075e59927c4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-7b9ba961-a67f-43b7-b840-b8bd78a7d290 req-89352ec2-eb85-445a-85c0-0075e59927c4 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Detach interface failed, port_id=a045650c-7390-47e9-9a99-586c63fcd273, reason: Instance 8662b876-8ed7-4b01-b28a-ce551b8d0097 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:55 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Took 1.13 seconds to deallocate network for instance.
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Deleted allocations for instance 8662b876-8ed7-4b01-b28a-ce551b8d0097
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d1c22255-f97d-4187-8e59-98eb36ab1a29 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.484s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:55 user nova-compute[73110]: WARNING nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state deleted and task_state None.
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:55 user nova-compute[73110]: WARNING nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-unplugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state deleted and task_state None.
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Acquiring lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] Lock "8662b876-8ed7-4b01-b28a-ce551b8d0097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] No waiting events found dispatching network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:49:55 user nova-compute[73110]: WARNING nova.compute.manager [req-28a36204-181d-4a3b-a676-a2ccb22a0c66 req-aa4a2ea6-7c2f-4639-a37b-bdcd260f33e9 service nova] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Received unexpected event network-vif-plugged-a045650c-7390-47e9-9a99-586c63fcd273 for instance with vm_state deleted and task_state None.
Aug 26 17:49:56 user nova-compute[73110]: INFO nova.compute.manager [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Took 0.88 seconds to detach 1 volumes for instance.
Aug 26 17:49:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Deleting volume: 53116ae7-3d6c-447d-9016-36fef4bab6d8 {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-8ec78b65-13cd-4b5e-91dc-bb8ec6607383 req-54fed748-ab74-45e5-b46b-924954ffbe1d service nova] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Received event network-vif-deleted-d1dd4f93-8bf7-474d-a10c-aa26b1c28ab1 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:56 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Deleted allocations for instance 2faed1ff-2bc7-4e0e-8034-4a893fd82871
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4e4dab76-09d5-4111-8dac-7d5b4ff951b5 tempest-ServerActionsV293TestJSON-1105370441 tempest-ServerActionsV293TestJSON-1105370441-project-member] Lock "2faed1ff-2bc7-4e0e-8034-4a893fd82871" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.530s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:56 user nova-compute[73110]: INFO nova.compute.manager [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attaching volume 809b66ae-efc3-466f-841a-4dac43cce409 to /dev/vdb
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.utils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c038bb-f374-46b1-87b9-1bb3f41d3522]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d96cfd6-adcc-495e-b040-dab295b5907a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bcc785-6611-4d8e-850a-8977248b0a9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e42e41-6bf7-4c66-84c7-1b6704a236a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:49:57 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b680db52-fb1a-4fe3-94b8-8dbb5c184060]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG os_brick.utils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating existing volume attachment record: ed5fc9eb-061e-4248-9e45-69c13ae2d0b1 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:49:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:49:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [{"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:49:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-e277fb69-1fba-42da-98f6-7b55b892788e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:49:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:49:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:49:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:50:02 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:02 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.476322174072266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e277fb69-1fba-42da-98f6-7b55b892788e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance db7fad40-12ca-494e-a6e6-f47dd66890c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:50:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:50:03 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:50:03 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:50:03 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:50:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:06 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072191.8408298, 7a5294e5-ba09-49bd-b78a-33ebc306d925 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:06 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] VM Stopped (Lifecycle Event)
Aug 26 17:50:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7d63adf0-ab1e-4fdb-8fcf-cfc44a5cceb3 None None] [instance: 7a5294e5-ba09-49bd-b78a-33ebc306d925] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:08 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072193.2811317, 8662b876-8ed7-4b01-b28a-ce551b8d0097 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:08 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] VM Stopped (Lifecycle Event)
Aug 26 17:50:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-003eceba-5c2e-45de-91b3-33bc06cbc40d None None] [instance: 8662b876-8ed7-4b01-b28a-ce551b8d0097] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:08 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072193.3245015, 2faed1ff-2bc7-4e0e-8034-4a893fd82871 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:08 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] VM Stopped (Lifecycle Event)
Aug 26 17:50:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-382b9b3a-4c4a-4f12-bb7d-6c3a17798d1d None None] [instance: 2faed1ff-2bc7-4e0e-8034-4a893fd82871] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuejBRtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:50:09 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:50:09 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:50:09 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e7a98-7fd8-427e-919f-d580b2e0aa40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:50:09 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b9e2f-b77a-44bb-94fc-df050cb993e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409] added
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[201249c7-3a20-4a83-93f7-3d655e0721df]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ede76-904b-411b-8678-a6b153865d0a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuejBRtG {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuejBRtG" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea522355-bb1e-44b8-9eee-8f3429c7ace1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuejBRtG'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e28d8-830b-41e5-a5e0-571a50aa5c2b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ef494-8b78-45f8-a16b-156566624080]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3e0cb8-feaa-4fdb-840a-be55516216d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260]
Aug 26 17:50:09 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260] successful.
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[af45aa4c-1dd7-48e1-ba28-3bdd3e78942d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477a213-6862-47be-b253-66a95b5096a0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)
Aug 26 17:50:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7f83e-f7df-45e0-8dda-cf1aab331609]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:50:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuejBRtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26265383830643135', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265383830643135', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:50:10 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:10 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:50:10 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:50:10 user nova-compute[73110]:   <serial>809b66ae-efc3-466f-841a-4dac43cce409</serial>
Aug 26 17:50:10 user nova-compute[73110]: </disk>
Aug 26 17:50:10 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:50:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No VIF found with MAC fa:16:3e:19:82:35, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:50:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7898504d-be16-49bf-a869-23d94c1402c0 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.192s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:13 user nova-compute[73110]: INFO nova.compute.manager [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Detaching volume 809b66ae-efc3-466f-841a-4dac43cce409
Aug 26 17:50:13 user nova-compute[73110]: INFO nova.virt.block_device [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attempting to driver detach volume 809b66ae-efc3-466f-841a-4dac43cce409 from mountpoint /dev/vdb
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Attempting to detach device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:14 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:14 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:50:14 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:50:14 user nova-compute[73110]:   <serial>809b66ae-efc3-466f-841a-4dac43cce409</serial>
Aug 26 17:50:14 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:50:14 user nova-compute[73110]: </disk>
Aug 26 17:50:14 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config.
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:14 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:14 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:50:14 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:50:14 user nova-compute[73110]:   <serial>809b66ae-efc3-466f-841a-4dac43cce409</serial>
Aug 26 17:50:14 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:50:14 user nova-compute[73110]: </disk>
Aug 26 17:50:14 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072214.4665575, f7c61d60-b862-475f-84cd-bf03501890b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:50:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config.
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuejBRtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:50:14 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a35232b-5543-4c27-9216-1184e9ad8ccf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e06f2-f6f5-4e84-b5ce-3513ca177835]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:14 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:14 user nova-compute[73110]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)
Aug 26 17:50:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:14 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:14 user nova-compute[73110]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 (non-flash)
Aug 26 17:50:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5446d0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c849cb-ad9d-4cb8-85a8-d1b1716f26e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c6191-4b6f-4880-aeb5-59d0d54bc779]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a6354d-e32b-447e-86ff-3e3a197f86ab]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.076s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f40a3-2bcb-46ec-a78b-2caa204225b8]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9e758-6704-437c-bff5-255722c18046]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[153165ab-c98a-4e7c-9afd-29cbcf75b498]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260]
Aug 26 17:50:14 user nova-compute[73110]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409, portal: 172.16.0.220,3260] successful.
Aug 26 17:50:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809b66ae-efc3-466f-841a-4dac43cce409 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ba708-f09f-4fb4-a927-5d78e865b590]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== disconnect_volume: return (338ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:50:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:50:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e13b66d8-bbab-42cc-b0e7-c42b26652b21 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:24 user nova-compute[73110]: INFO nova.compute.manager [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Detaching volume 8ee52f3a-8aaa-43df-840b-357b9350724f
Aug 26 17:50:24 user nova-compute[73110]: INFO nova.virt.block_device [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Attempting to driver detach volume 8ee52f3a-8aaa-43df-840b-357b9350724f from mountpoint /dev/vdb
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Attempting to detach device vdb from instance 23d907b6-f633-40a1-976f-ccd87e780cf1 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:24 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:50:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:50:24 user nova-compute[73110]:   <serial>8ee52f3a-8aaa-43df-840b-357b9350724f</serial>
Aug 26 17:50:24 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:50:24 user nova-compute[73110]: </disk>
Aug 26 17:50:24 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance 23d907b6-f633-40a1-976f-ccd87e780cf1 from the persistent domain config.
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23d907b6-f633-40a1-976f-ccd87e780cf1 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:24 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:50:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:50:24 user nova-compute[73110]:   <serial>8ee52f3a-8aaa-43df-840b-357b9350724f</serial>
Aug 26 17:50:24 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:50:24 user nova-compute[73110]: </disk>
Aug 26 17:50:24 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072224.8654747, 23d907b6-f633-40a1-976f-ccd87e780cf1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:50:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance 23d907b6-f633-40a1-976f-ccd87e780cf1 from the live domain config.
Aug 26 17:50:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGhZcpsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:50:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d582799-72fc-4e13-b74c-be924b0c5d29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[025e3020-db67-4a89-aa9e-fb5d1619975e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:24 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f (non-flash)
Aug 26 17:50:24 user nova-compute[73110]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520eb7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7ebd8-94ec-46b7-9a05-7d4a952f8a19]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe6633c-7dc1-4178-b114-53a7fb84132b]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba049814-4cde-4d5b-b17b-c9a83bf06408]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5ade4-e89c-4ab0-94de-05e012556e45]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5754ba2c-beb2-4563-9940-70bc6bb946dc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8186344-268d-45fd-b6d6-a5ab00c202a7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260]
Aug 26 17:50:25 user nova-compute[73110]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f, portal: 172.16.0.220,3260] successful.
Aug 26 17:50:25 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee52f3a-8aaa-43df-840b-357b9350724f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dbed56-865d-40c8-b81c-3c05243b0324]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== disconnect_volume: return (323ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:50:25 user nova-compute[73110]: INFO nova.compute.claims [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Claim successful on node user
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:50:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.policy [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a8aa997bb214e5f9aa5fd0badb394be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5fcf35a12ef444b87aff6fa79bff21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:50:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Creating image(s)
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.objects.instance [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:50:26 user nova-compute[73110]: INFO nova.compute.claims [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Claim successful on node user
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-09fd3499-5372-4555-ac22-0abd60063f3c tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk 1073741824" returned: 0 in 0.068s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Successfully created port: 4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:50:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.policy [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a8aa997bb214e5f9aa5fd0badb394be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5fcf35a12ef444b87aff6fa79bff21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:50:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Creating image(s)
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk 1073741824" returned: 0 in 0.056s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Successfully created port: e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Cannot resize image /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Ensure instance console log exists: /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Successfully updated port: 4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-changed-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Refreshing instance network info cache due to event network-changed-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance network_info: |[{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Refreshing network info cache for port 4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start _get_guest_xml network_info=[{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-326749718',display_name='tempest-ServerRescueNegativeTestJSON-server-326749718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-326749718',id=23,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-2ni9c1a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:26Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=d7c5e50e-1035-438b-82c0-946cb4c36547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Successfully updated port: e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:50:28 user nova-compute[73110]:   <uuid>d7c5e50e-1035-438b-82c0-946cb4c36547</uuid>
Aug 26 17:50:28 user nova-compute[73110]:   <name>instance-00000017</name>
Aug 26 17:50:28 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:50:28 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:50:28 user nova-compute[73110]:   <metadata>
Aug 26 17:50:28 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:50:28 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-326749718</nova:name>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:50:28</nova:creationTime>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:50:28 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:50:28 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:owner>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 17:50:28 user nova-compute[73110]:       </nova:owner>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:50:28 user nova-compute[73110]:       <nova:ports>
Aug 26 17:50:28 user nova-compute[73110]:         <nova:port uuid="4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d">
Aug 26 17:50:28 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:50:28 user nova-compute[73110]:         </nova:port>
Aug 26 17:50:28 user nova-compute[73110]:       </nova:ports>
Aug 26 17:50:28 user nova-compute[73110]:     </nova:instance>
Aug 26 17:50:28 user nova-compute[73110]:   </metadata>
Aug 26 17:50:28 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:50:28 user nova-compute[73110]:     <system>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="serial">d7c5e50e-1035-438b-82c0-946cb4c36547</entry>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="uuid">d7c5e50e-1035-438b-82c0-946cb4c36547</entry>
Aug 26 17:50:28 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:50:28 user nova-compute[73110]:     </system>
Aug 26 17:50:28 user nova-compute[73110]:   </sysinfo>
Aug 26 17:50:28 user nova-compute[73110]:   <os>
Aug 26 17:50:28 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:50:28 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:50:28 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:50:28 user nova-compute[73110]:   </os>
Aug 26 17:50:28 user nova-compute[73110]:   <features>
Aug 26 17:50:28 user nova-compute[73110]:     <acpi/>
Aug 26 17:50:28 user nova-compute[73110]:     <apic/>
Aug 26 17:50:28 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:50:28 user nova-compute[73110]:   </features>
Aug 26 17:50:28 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:50:28 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:50:28 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:50:28 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:50:28 user nova-compute[73110]:   </clock>
Aug 26 17:50:28 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:50:28 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:50:28 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:50:28 user nova-compute[73110]:   </cpu>
Aug 26 17:50:28 user nova-compute[73110]:   <devices>
Aug 26 17:50:28 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:50:28 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:50:28 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk"/>
Aug 26 17:50:28 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:50:28 user nova-compute[73110]:     </disk>
Aug 26 17:50:28 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:50:28 user nova-compute[73110]:       <mac address="fa:16:3e:62:9f:6c"/>
Aug 26 17:50:28 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:28 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:50:28 user nova-compute[73110]:       <target dev="tap4c4dfc55-0f"/>
Aug 26 17:50:28 user nova-compute[73110]:     </interface>
Aug 26 17:50:28 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:50:28 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/console.log" append="off"/>
Aug 26 17:50:28 user nova-compute[73110]:     </serial>
Aug 26 17:50:28 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:50:28 user nova-compute[73110]:     <video>
Aug 26 17:50:28 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:28 user nova-compute[73110]:     </video>
Aug 26 17:50:28 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:50:28 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:50:28 user nova-compute[73110]:     </rng>
Aug 26 17:50:28 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:50:28 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:50:28 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:50:28 user nova-compute[73110]:     </memballoon>
Aug 26 17:50:28 user nova-compute[73110]:   </devices>
Aug 26 17:50:28 user nova-compute[73110]: </domain>
Aug 26 17:50:28 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-326749718',display_name='tempest-ServerRescueNegativeTestJSON-server-326749718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-326749718',id=23,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-2ni9c1a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:26Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=d7c5e50e-1035-438b-82c0-946cb4c36547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG os_vif [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c4dfc55-0f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c4dfc55-0f, col_values=(('external_ids', {'iface-id': '4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:9f:6c', 'vm-uuid': 'd7c5e50e-1035-438b-82c0-946cb4c36547'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-changed-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Refreshing instance network info cache due to event network-changed-e4282f7b-d25a-40b4-b583-108158205f46. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] Acquiring lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:50:28 user nova-compute[73110]: INFO os_vif [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f')
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:62:9f:6c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance network_info: |[{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] Acquired lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Refreshing network info cache for port e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start _get_guest_xml network_info=[{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updated VIF entry in instance network info cache for port 4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32b94ccd-5dd5-4ca3-ac89-02e734073ac9 req-22571ec0-84bf-4ef0-8950-789417b70354 service nova] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:50:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2123724910',display_name='tempest-ServerRescueNegativeTestJSON-server-2123724910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2123724910',id=24,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-y2ex1qea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:27Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=573d5b76-ace4-471a-a1d4-5a770389d14f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:50:29 user nova-compute[73110]:   <uuid>573d5b76-ace4-471a-a1d4-5a770389d14f</uuid>
Aug 26 17:50:29 user nova-compute[73110]:   <name>instance-00000018</name>
Aug 26 17:50:29 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:50:29 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:50:29 user nova-compute[73110]:   <metadata>
Aug 26 17:50:29 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:50:29 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2123724910</nova:name>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:50:28</nova:creationTime>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:50:29 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:50:29 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:owner>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 17:50:29 user nova-compute[73110]:       </nova:owner>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:50:29 user nova-compute[73110]:       <nova:ports>
Aug 26 17:50:29 user nova-compute[73110]:         <nova:port uuid="e4282f7b-d25a-40b4-b583-108158205f46">
Aug 26 17:50:29 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 17:50:29 user nova-compute[73110]:         </nova:port>
Aug 26 17:50:29 user nova-compute[73110]:       </nova:ports>
Aug 26 17:50:29 user nova-compute[73110]:     </nova:instance>
Aug 26 17:50:29 user nova-compute[73110]:   </metadata>
Aug 26 17:50:29 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:50:29 user nova-compute[73110]:     <system>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="serial">573d5b76-ace4-471a-a1d4-5a770389d14f</entry>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="uuid">573d5b76-ace4-471a-a1d4-5a770389d14f</entry>
Aug 26 17:50:29 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:50:29 user nova-compute[73110]:     </system>
Aug 26 17:50:29 user nova-compute[73110]:   </sysinfo>
Aug 26 17:50:29 user nova-compute[73110]:   <os>
Aug 26 17:50:29 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:50:29 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:50:29 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:50:29 user nova-compute[73110]:   </os>
Aug 26 17:50:29 user nova-compute[73110]:   <features>
Aug 26 17:50:29 user nova-compute[73110]:     <acpi/>
Aug 26 17:50:29 user nova-compute[73110]:     <apic/>
Aug 26 17:50:29 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:50:29 user nova-compute[73110]:   </features>
Aug 26 17:50:29 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:50:29 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:50:29 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:50:29 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:50:29 user nova-compute[73110]:   </clock>
Aug 26 17:50:29 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:50:29 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:50:29 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:50:29 user nova-compute[73110]:   </cpu>
Aug 26 17:50:29 user nova-compute[73110]:   <devices>
Aug 26 17:50:29 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:50:29 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:50:29 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk"/>
Aug 26 17:50:29 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:50:29 user nova-compute[73110]:     </disk>
Aug 26 17:50:29 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:50:29 user nova-compute[73110]:       <mac address="fa:16:3e:16:dc:2b"/>
Aug 26 17:50:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:29 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:50:29 user nova-compute[73110]:       <target dev="tape4282f7b-d2"/>
Aug 26 17:50:29 user nova-compute[73110]:     </interface>
Aug 26 17:50:29 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:50:29 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/console.log" append="off"/>
Aug 26 17:50:29 user nova-compute[73110]:     </serial>
Aug 26 17:50:29 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:50:29 user nova-compute[73110]:     <video>
Aug 26 17:50:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:29 user nova-compute[73110]:     </video>
Aug 26 17:50:29 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:50:29 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:50:29 user nova-compute[73110]:     </rng>
Aug 26 17:50:29 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:50:29 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:50:29 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:50:29 user nova-compute[73110]:     </memballoon>
Aug 26 17:50:29 user nova-compute[73110]:   </devices>
Aug 26 17:50:29 user nova-compute[73110]: </domain>
Aug 26 17:50:29 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2123724910',display_name='tempest-ServerRescueNegativeTestJSON-server-2123724910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2123724910',id=24,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-y2ex1qea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:27Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=573d5b76-ace4-471a-a1d4-5a770389d14f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG os_vif [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4282f7b-d2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4282f7b-d2, col_values=(('external_ids', {'iface-id': 'e4282f7b-d25a-40b4-b583-108158205f46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:dc:2b', 'vm-uuid': '573d5b76-ace4-471a-a1d4-5a770389d14f'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:29 user nova-compute[73110]: INFO os_vif [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2')
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:16:dc:2b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updated VIF entry in instance network info cache for port e4282f7b-d25a-40b4-b583-108158205f46. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e69177f-626e-428a-b74d-de4b9289f930 req-40316eb5-cd86-4572-8667-0d3b5682715e service nova] Releasing lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:31 user nova-compute[73110]: WARNING nova.compute.manager [req-68ce4d35-9b5b-43c3-9097-9a50b0074b6d req-1176ee55-a418-4d2b-b911-fdf79d0bc1a3 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state building and task_state spawning.
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:31 user nova-compute[73110]: WARNING nova.compute.manager [req-11db03a1-8b0f-46b5-8d1d-2c121b719e48 req-05106c4b-edd6-4aa1-a9bb-863f15bf2f8c service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state building and task_state spawning.
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:33 user nova-compute[73110]: WARNING nova.compute.manager [req-ff870d0d-e381-45f4-a5ce-6ccf400041d3 req-e0db8cb3-5bf0-4db3-a861-b2296e9fd459 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state building and task_state spawning.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:33 user nova-compute[73110]: WARNING nova.compute.manager [req-35ca9f38-cc9c-4adb-9ae0-218a86964e3b req-41e793e9-c32b-4dad-813d-cd81d7bcf4a8 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state building and task_state spawning.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072233.7729638, 573d5b76-ace4-471a-a1d4-5a770389d14f => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] VM Resumed (Lifecycle Event)
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance spawned successfully.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance spawned successfully.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072233.7746751, 573d5b76-ace4-471a-a1d4-5a770389d14f => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] VM Started (Lifecycle Event)
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072233.7801344, d7c5e50e-1035-438b-82c0-946cb4c36547 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Resumed (Lifecycle Event)
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Took 8.11 seconds to spawn the instance on the hypervisor.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Took 7.90 seconds to build instance.
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:50:33 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072233.781769, d7c5e50e-1035-438b-82c0-946cb4c36547 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:33 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Started (Lifecycle Event)
Aug 26 17:50:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2ae0a6fe-2cfd-4f63-a526-344ba91a1e0c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.032s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:34 user nova-compute[73110]: INFO nova.compute.manager [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Took 8.87 seconds to build instance.
Aug 26 17:50:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3571ee7f-8c5a-474a-8658-6d0d6b34a6eb tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.972s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:50:46 user nova-compute[73110]: INFO nova.compute.claims [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Claim successful on node user
Aug 26 17:50:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:50:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.policy [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65b8f68535c94d32b9178427f2654db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ce94322c8d42b5a3dbd2af9e84c263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:50:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Creating image(s)
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "/opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "/opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.215s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk 1073741824" returned: 0 in 0.063s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:50:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Cannot resize image /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Ensure instance console log exists: /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Successfully created port: b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:50:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Successfully updated port: b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquired lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-changed-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Refreshing instance network info cache due to event network-changed-b98feb61-a4ce-4b66-9591-45b7fe149266. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] Acquiring lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.neutron [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating instance_info_cache with network_info: [{"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Releasing lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Instance network_info: |[{"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] Acquired lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.neutron [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Refreshing network info cache for port b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Start _get_guest_xml network_info=[{"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:50:49 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:49 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-673511871',display_name='tempest-AttachVolumeTestJSON-server-673511871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-673511871',id=25,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5h7dwVcKgjJUjHBLP9T34qoS71R8XSXBblH/D4efgQMCfnRt25g6qlSc2SKdFBc2GYcUTTzOpTDN/RbYskP2BEyGibScG3qUA8MtoMGSGqHWR3Tn5oLJLJ2Y91HKNdrA==',key_name='tempest-keypair-1971226456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-a5ick5rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=6a04afc7-0fe6-496a-97cb-9bf275b53da4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.objects.instance [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:50:49 user nova-compute[73110]:   <uuid>6a04afc7-0fe6-496a-97cb-9bf275b53da4</uuid>
Aug 26 17:50:49 user nova-compute[73110]:   <name>instance-00000019</name>
Aug 26 17:50:49 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:50:49 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:50:49 user nova-compute[73110]:   <metadata>
Aug 26 17:50:49 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:50:49 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeTestJSON-server-673511871</nova:name>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:50:49</nova:creationTime>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:50:49 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:50:49 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:owner>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:user uuid="65b8f68535c94d32b9178427f2654db8">tempest-AttachVolumeTestJSON-1129991883-project-member</nova:user>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:project uuid="38ce94322c8d42b5a3dbd2af9e84c263">tempest-AttachVolumeTestJSON-1129991883</nova:project>
Aug 26 17:50:49 user nova-compute[73110]:       </nova:owner>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:50:49 user nova-compute[73110]:       <nova:ports>
Aug 26 17:50:49 user nova-compute[73110]:         <nova:port uuid="b98feb61-a4ce-4b66-9591-45b7fe149266">
Aug 26 17:50:49 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:50:49 user nova-compute[73110]:         </nova:port>
Aug 26 17:50:49 user nova-compute[73110]:       </nova:ports>
Aug 26 17:50:49 user nova-compute[73110]:     </nova:instance>
Aug 26 17:50:49 user nova-compute[73110]:   </metadata>
Aug 26 17:50:49 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:50:49 user nova-compute[73110]:     <system>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="serial">6a04afc7-0fe6-496a-97cb-9bf275b53da4</entry>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="uuid">6a04afc7-0fe6-496a-97cb-9bf275b53da4</entry>
Aug 26 17:50:49 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:50:49 user nova-compute[73110]:     </system>
Aug 26 17:50:49 user nova-compute[73110]:   </sysinfo>
Aug 26 17:50:49 user nova-compute[73110]:   <os>
Aug 26 17:50:49 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:50:49 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:50:49 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:50:49 user nova-compute[73110]:   </os>
Aug 26 17:50:49 user nova-compute[73110]:   <features>
Aug 26 17:50:49 user nova-compute[73110]:     <acpi/>
Aug 26 17:50:49 user nova-compute[73110]:     <apic/>
Aug 26 17:50:49 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:50:49 user nova-compute[73110]:   </features>
Aug 26 17:50:49 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:50:49 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:50:49 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:50:49 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:50:49 user nova-compute[73110]:   </clock>
Aug 26 17:50:49 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:50:49 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:50:49 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:50:49 user nova-compute[73110]:   </cpu>
Aug 26 17:50:49 user nova-compute[73110]:   <devices>
Aug 26 17:50:49 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:50:49 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:50:49 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk"/>
Aug 26 17:50:49 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:50:49 user nova-compute[73110]:     </disk>
Aug 26 17:50:49 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:50:49 user nova-compute[73110]:       <mac address="fa:16:3e:ff:e1:4f"/>
Aug 26 17:50:49 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:49 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:50:49 user nova-compute[73110]:       <target dev="tapb98feb61-a4"/>
Aug 26 17:50:49 user nova-compute[73110]:     </interface>
Aug 26 17:50:49 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:50:49 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/console.log" append="off"/>
Aug 26 17:50:49 user nova-compute[73110]:     </serial>
Aug 26 17:50:49 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:50:49 user nova-compute[73110]:     <video>
Aug 26 17:50:49 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:50:49 user nova-compute[73110]:     </video>
Aug 26 17:50:49 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:50:49 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:50:49 user nova-compute[73110]:     </rng>
Aug 26 17:50:49 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:50:49 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:50:49 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:50:49 user nova-compute[73110]:     </memballoon>
Aug 26 17:50:49 user nova-compute[73110]:   </devices>
Aug 26 17:50:49 user nova-compute[73110]: </domain>
Aug 26 17:50:49 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-673511871',display_name='tempest-AttachVolumeTestJSON-server-673511871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-673511871',id=25,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5h7dwVcKgjJUjHBLP9T34qoS71R8XSXBblH/D4efgQMCfnRt25g6qlSc2SKdFBc2GYcUTTzOpTDN/RbYskP2BEyGibScG3qUA8MtoMGSGqHWR3Tn5oLJLJ2Y91HKNdrA==',key_name='tempest-keypair-1971226456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-a5ick5rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=6a04afc7-0fe6-496a-97cb-9bf275b53da4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG os_vif [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb98feb61-a4, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb98feb61-a4, col_values=(('external_ids', {'iface-id': 'b98feb61-a4ce-4b66-9591-45b7fe149266', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:e1:4f', 'vm-uuid': '6a04afc7-0fe6-496a-97cb-9bf275b53da4'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:49 user nova-compute[73110]: INFO os_vif [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4')
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:50:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No VIF found with MAC fa:16:3e:ff:e1:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:50:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updated VIF entry in instance network info cache for port b98feb61-a4ce-4b66-9591-45b7fe149266. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:50:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating instance_info_cache with network_info: [{"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bf833a09-7cc1-4098-a7d9-baa28cdd004d req-d1892896-f575-41f1-a903-63412cef93d9 service nova] Releasing lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] No waiting events found dispatching network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:51 user nova-compute[73110]: WARNING nova.compute.manager [req-2f78cb01-7ba7-40b9-b744-7bdb40d6d0c3 req-0498a6e1-820d-43c4-97e0-d018debd1bb2 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received unexpected event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 for instance with vm_state building and task_state spawning.
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072253.492383, 6a04afc7-0fe6-496a-97cb-9bf275b53da4 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] VM Resumed (Lifecycle Event)
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Instance spawned successfully.
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072253.494028, 6a04afc7-0fe6-496a-97cb-9bf275b53da4 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] VM Started (Lifecycle Event)
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] No waiting events found dispatching network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:50:53 user nova-compute[73110]: WARNING nova.compute.manager [req-954fccf6-4d81-4388-afd3-7bb62aacb42c req-db4f20ce-51b1-4d70-92ec-b917b30ddc1d service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received unexpected event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 for instance with vm_state building and task_state spawning.
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 26 17:50:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:50:53 user nova-compute[73110]: INFO nova.compute.manager [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Took 7.51 seconds to build instance.
Aug 26 17:50:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-72125ce4-b384-43ee-a94c-23b2a13838ef tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.629s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating instance_info_cache with network_info: [{"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-23d907b6-f633-40a1-976f-ccd87e780cf1" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:58 user nova-compute[73110]: INFO nova.compute.manager [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Detaching volume 351720c5-433e-486b-ae35-850feb7d0b52
Aug 26 17:50:58 user nova-compute[73110]: INFO nova.virt.block_device [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Attempting to driver detach volume 351720c5-433e-486b-ae35-850feb7d0b52 from mountpoint /dev/vdc
Aug 26 17:50:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Attempting to detach device vdc from instance e277fb69-1fba-42da-98f6-7b55b892788e from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:50:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:58 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:58 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 17:50:58 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:50:58 user nova-compute[73110]:   <serial>351720c5-433e-486b-ae35-850feb7d0b52</serial>
Aug 26 17:50:58 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:50:58 user nova-compute[73110]: </disk>
Aug 26 17:50:58 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully detached device vdc from instance e277fb69-1fba-42da-98f6-7b55b892788e from the persistent domain config.
Aug 26 17:50:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e277fb69-1fba-42da-98f6-7b55b892788e from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:50:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:50:58 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:50:58 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 17:50:58 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:50:58 user nova-compute[73110]:   <serial>351720c5-433e-486b-ae35-850feb7d0b52</serial>
Aug 26 17:50:58 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 17:50:58 user nova-compute[73110]: </disk>
Aug 26 17:50:58 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072259.4165585, e277fb69-1fba-42da-98f6-7b55b892788e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:50:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully detached device vdc from instance e277fb69-1fba-42da-98f6-7b55b892788e from the live domain config.
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFuWGPUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:50:59 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b88a189-353e-4b5e-a7c3-dd829209e24b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd91b8-1fcc-4a41-ad77-5524a92062e1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 (non-flash)
Aug 26 17:50:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520ef3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a8b16-314a-4dd0-80c1-c5a5ab73e09f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2f270-6258-4d75-b18c-1dffa46808f5]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc8455-ab89-48ef-b3d5-30d0c8cce774]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f4f89-3860-4930-9eca-0688036e6c9b]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d848e-ef38-4a7f-91d5-b37dadb3e9cf]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6176b5-eb0a-4103-8414-f43381000cd8]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260]
Aug 26 17:50:59 user nova-compute[73110]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52, portal: 172.16.0.220,3260] successful.
Aug 26 17:50:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351720c5-433e-486b-ae35-850feb7d0b52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f5c90-abe5-425e-b4c7-8004d2eddc75]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] <== disconnect_volume: return (333ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:50:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'flavor' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1cfafc27-3684-4316-b006-60fe407788ec tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.989s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:04 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:51:04 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:51:04 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7246MB free_disk=25.369674682617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:51:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 23d907b6-f633-40a1-976f-ccd87e780cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e277fb69-1fba-42da-98f6-7b55b892788e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance db7fad40-12ca-494e-a6e6-f47dd66890c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:51:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.896s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 17:51:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 17:51:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:11 user nova-compute[73110]: INFO nova.compute.manager [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attaching volume 821b2391-17b7-4569-b703-35fe495eee2d to /dev/vdb
Aug 26 17:51:11 user nova-compute[73110]: DEBUG os_brick.utils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e84cee-e7fc-41fd-8c56-a044bea695d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d0dc0d-3c8b-4684-9290-cf16f425b23d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa6f415-2e5d-441b-b038-0abb8e4f129b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58106d6-cb35-4483-be79-218d2ee9a2df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:51:12 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c353b3-ccb0-4e04-8daa-3db6dd982a0d]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG os_brick.utils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating existing volume attachment record: d705ff87-4e96-4864-a995-0188e3ccc542 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:51:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:12 user nova-compute[73110]: INFO nova.compute.manager [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] instance snapshotting
Aug 26 17:51:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Beginning live snapshot process
Aug 26 17:51:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.170s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1.delta 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1.delta 1073741824" returned: 0 in 0.057s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:14 user nova-compute[73110]: INFO nova.compute.manager [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Terminating instance
Aug 26 17:51:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:51:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 17:51:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:51:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1.delta /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-unplugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] No waiting events found dispatching network-vif-unplugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-06baa07f-a7c0-4262-97cc-1f0938e03618 req-a6b41c8c-42d1-437e-8bc9-0d761343f763 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-unplugged-45be2928-8345-4117-ad38-e992f43ebb8a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Instance destroyed successfully.
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'resources' on Instance uuid 23d907b6-f633-40a1-976f-ccd87e780cf1 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2024350329',display_name='tempest-AttachVolumeNegativeTest-server-2024350329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2024350329',id=16,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzRLGJa/XrjAmRxV6V1tTxjsKhRJcoUtf9PSplbreirryjNvAsk0/i5weKvXiVvaLuZUJEt1k7nTLN+at4Qr0u5kSv4J+Cs9aIKAgog6JEVnZ9sNbn1zMdfC1H6K4hwYA==',key_name='tempest-keypair-963001878',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-o1vtnvpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=23d907b6-f633-40a1-976f-ccd87e780cf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "45be2928-8345-4117-ad38-e992f43ebb8a", "address": "fa:16:3e:7d:09:ed", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45be2928-83", "ovs_interfaceid": "45be2928-8345-4117-ad38-e992f43ebb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG os_vif [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45be2928-83, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:51:15 user nova-compute[73110]: INFO os_vif [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:09:ed,bridge_name='br-int',has_traffic_filtering=True,id=45be2928-8345-4117-ad38-e992f43ebb8a,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45be2928-83')
Aug 26 17:51:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Deleting instance files /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1_del
Aug 26 17:51:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Deletion of /opt/stack/data/nova/instances/23d907b6-f633-40a1-976f-ccd87e780cf1_del complete
Aug 26 17:51:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1.delta /opt/stack/data/nova/instances/snapshots/tmpwy1bx_n_/55cfbdb43f764fe4a032f3ca42c557b1" returned: 0 in 0.777s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Snapshot extracted, beginning image upload
Aug 26 17:51:15 user nova-compute[73110]: INFO nova.compute.manager [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 26 17:51:15 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:51:15 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:51:16 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:16 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Took 0.94 seconds to deallocate network for instance.
Aug 26 17:51:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] Acquiring lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] No waiting events found dispatching network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:17 user nova-compute[73110]: WARNING nova.compute.manager [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received unexpected event network-vif-plugged-45be2928-8345-4117-ad38-e992f43ebb8a for instance with vm_state deleted and task_state None.
Aug 26 17:51:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-78a05574-a863-4e64-b7dd-2a1469156684 req-6da599f4-0fe4-4414-b16f-d4d13c0407a4 service nova] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Received event network-vif-deleted-45be2928-8345-4117-ad38-e992f43ebb8a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:17 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Deleted allocations for instance 23d907b6-f633-40a1-976f-ccd87e780cf1
Aug 26 17:51:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-663525ec-02a7-47c0-858d-2f3ec6cad2aa tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "23d907b6-f633-40a1-976f-ccd87e780cf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Snapshot image upload complete
Aug 26 17:51:18 user nova-compute[73110]: INFO nova.compute.manager [None req-d4da271b-3f2f-4ad1-a875-955c51dcf6e4 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Took 5.67 seconds to snapshot the instance on the hypervisor.
Aug 26 17:51:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhjazmRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:51:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:51:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:51:24 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f40928-493d-4fae-b1aa-34aa24d06a2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:51:24 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300dfb6-d9c1-43db-9887-3ed3916a7aaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d] added
Aug 26 17:51:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b3ce0-ceb0-41b5-9173-20af312cd651]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f64a0-9ec2-4c20-b82b-86c128b3e13c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhjazmRt {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhjazmRt" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0372e-5c03-47a5-a581-9ef993309b5d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhjazmRt'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.089s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2aa89-b5ff-4238-80a4-51ae52f1e05c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73a134-1712-4a9f-9b39-fed73cbafcbf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:51:24 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:51:24 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:51:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:51:24 user nova-compute[73110]: 
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d74e92-92b6-42a7-b35f-ecc10b6ecb20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260]
Aug 26 17:51:24 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260] successful.
Aug 26 17:51:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[05574648-63c5-40df-a79c-927d6151a8d2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd16d675-b00e-4e21-8839-2de29aaecb8d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)
Aug 26 17:51:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)
Aug 26 17:51:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554e2a7-719b-461e-8321-831c27a883e4]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:51:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhjazmRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23030303639356132', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303639356132', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:51:25 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:51:25 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:51:25 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:51:25 user nova-compute[73110]:   <serial>821b2391-17b7-4569-b703-35fe495eee2d</serial>
Aug 26 17:51:25 user nova-compute[73110]: </disk>
Aug 26 17:51:25 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:51:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:51:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:51:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No VIF found with MAC fa:16:3e:19:82:35, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:51:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a1852d21-784f-493d-b273-5277c8a37816 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.649s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:28 user nova-compute[73110]: INFO nova.compute.manager [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Detaching volume 821b2391-17b7-4569-b703-35fe495eee2d
Aug 26 17:51:28 user nova-compute[73110]: INFO nova.virt.block_device [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attempting to driver detach volume 821b2391-17b7-4569-b703-35fe495eee2d from mountpoint /dev/vdb
Aug 26 17:51:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Attempting to detach device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:51:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:51:28 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:51:28 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:51:28 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:51:28 user nova-compute[73110]:   <serial>821b2391-17b7-4569-b703-35fe495eee2d</serial>
Aug 26 17:51:28 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:51:28 user nova-compute[73110]: </disk>
Aug 26 17:51:28 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:51:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config.
Aug 26 17:51:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:51:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:51:28 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:51:28 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:51:28 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:51:28 user nova-compute[73110]:   <serial>821b2391-17b7-4569-b703-35fe495eee2d</serial>
Aug 26 17:51:28 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:51:28 user nova-compute[73110]: </disk>
Aug 26 17:51:28 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072289.2993705, f7c61d60-b862-475f-84cd-bf03501890b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:51:29 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config.
Aug 26 17:51:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhjazmRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:51:29 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd941f-c826-4b7a-97bc-c2516659a307]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed90407-8ea8-45cc-a121-5e2240e5ec85]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)
Aug 26 17:51:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d (non-flash)
Aug 26 17:51:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520ee6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bb953-efa6-4ace-b21f-99089b3a4667]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062cc00-fec5-45af-a759-3e09a692431a]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[045063fe-a72d-429c-851d-9d3158f0cc86]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f7c71e-0fe1-464a-ae0e-e21dc7b4c935]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd026fd-4eb7-4aa2-8a7f-c05f697285e9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc105bd-5c6b-4ed8-8a6f-802b8720ceb9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260]
Aug 26 17:51:29 user nova-compute[73110]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d, portal: 172.16.0.220,3260] successful.
Aug 26 17:51:29 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821b2391-17b7-4569-b703-35fe495eee2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d73cce-7857-4538-afa1-954c32b49795]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== disconnect_volume: return (273ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:51:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:51:30 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8596d3dc-efc3-4166-97b7-11c96402ff02 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:30 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072275.6672685, 23d907b6-f633-40a1-976f-ccd87e780cf1 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:51:30 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] VM Stopped (Lifecycle Event)
Aug 26 17:51:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-32ba28d6-f778-48f9-be06-08997ff0a73d None None] [instance: 23d907b6-f633-40a1-976f-ccd87e780cf1] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:35 user nova-compute[73110]: INFO nova.compute.manager [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Terminating instance
Aug 26 17:51:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-unplugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] No waiting events found dispatching network-vif-unplugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-6b83be6b-2a62-4719-8554-815a1d10acc5 req-ccd0f1dc-501d-4191-bf1d-d66dba1d11ee service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-unplugged-f8ada419-a655-4bbd-af84-f7085cf103b6 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:51:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Instance destroyed successfully.
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lazy-loading 'resources' on Instance uuid db7fad40-12ca-494e-a6e6-f47dd66890c2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490761801',display_name='tempest-ServersNegativeTestJSON-server-1490761801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490761801',id=22,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-l0054p3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:49:53Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=db7fad40-12ca-494e-a6e6-f47dd66890c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "f8ada419-a655-4bbd-af84-f7085cf103b6", "address": "fa:16:3e:24:6a:f1", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8ada419-a6", "ovs_interfaceid": "f8ada419-a655-4bbd-af84-f7085cf103b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG os_vif [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8ada419-a6, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:51:36 user nova-compute[73110]: INFO os_vif [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6a:f1,bridge_name='br-int',has_traffic_filtering=True,id=f8ada419-a655-4bbd-af84-f7085cf103b6,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8ada419-a6')
Aug 26 17:51:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Deleting instance files /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2_del
Aug 26 17:51:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Deletion of /opt/stack/data/nova/instances/db7fad40-12ca-494e-a6e6-f47dd66890c2_del complete
Aug 26 17:51:36 user nova-compute[73110]: INFO nova.compute.manager [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 26 17:51:36 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:51:36 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:37 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Took 0.94 seconds to deallocate network for instance.
Aug 26 17:51:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-21958063-5e5e-41bc-bb87-f89f3bcbdedd req-1a113c4c-ca5c-4d14-a3b3-188175c24fd8 service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-deleted-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:37 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Deleted allocations for instance db7fad40-12ca-494e-a6e6-f47dd66890c2
Aug 26 17:51:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1ff154a-ec76-4531-bea3-868576dbdcc1 tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] Acquiring lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] Lock "db7fad40-12ca-494e-a6e6-f47dd66890c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] No waiting events found dispatching network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:38 user nova-compute[73110]: WARNING nova.compute.manager [req-700af948-7599-4cee-83f0-649d8f47623e req-4980e3ba-62ff-452e-adca-64159df49f2d service nova] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Received unexpected event network-vif-plugged-f8ada419-a655-4bbd-af84-f7085cf103b6 for instance with vm_state deleted and task_state None.
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:38 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:51:38 user nova-compute[73110]: INFO nova.compute.claims [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Claim successful on node user
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:51:39 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.policy [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18c0042b00f44f28bfa5ef33f17da542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10eea5ee4c32437db9430b6acd32b6f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:51:39 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Creating image(s)
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "/opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "/opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "/opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk 1073741824" returned: 0 in 0.059s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Successfully created port: 162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Cannot resize image /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Ensure instance console log exists: /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Successfully updated port: 162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquired lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-changed-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Refreshing instance network info cache due to event network-changed-162d41c7-3306-486e-8780-d73a62ab91bb. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] Acquiring lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating instance_info_cache with network_info: [{"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Releasing lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Instance network_info: |[{"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] Acquired lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.neutron [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Refreshing network info cache for port 162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Start _get_guest_xml network_info=[{"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:51:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:51:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-173549576',display_name='tempest-TestServerVolumeAttachmentScenario-server-173549576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-173549576',id=26,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNihgUwani/QMOMlPugJBwlSifpEiGkiiCbxsycbgYwnMmHui5cy3PkVZhMDU5oethM53LfYoKm0ceKAyXdBTAERdIRIbCLt0eZkwS+N+K4kCEbK7VkkydpGHNlwg7HD9w==',key_name='tempest-keypair-937206110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10eea5ee4c32437db9430b6acd32b6f9',ramdisk_id='',reservation_id='r-l01qhooa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1419611542',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1419611542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c0042b00f44f28bfa5ef33f17da542',uuid=8098e997-fdb1-43ee-bb8a-bed248e3461e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converting VIF {"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.objects.instance [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'pci_devices' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:51:41 user nova-compute[73110]:   <uuid>8098e997-fdb1-43ee-bb8a-bed248e3461e</uuid>
Aug 26 17:51:41 user nova-compute[73110]:   <name>instance-0000001a</name>
Aug 26 17:51:41 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:51:41 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:51:41 user nova-compute[73110]:   <metadata>
Aug 26 17:51:41 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:51:41 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-173549576</nova:name>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:51:41</nova:creationTime>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:51:41 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:51:41 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:owner>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:user uuid="18c0042b00f44f28bfa5ef33f17da542">tempest-TestServerVolumeAttachmentScenario-1419611542-project-member</nova:user>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:project uuid="10eea5ee4c32437db9430b6acd32b6f9">tempest-TestServerVolumeAttachmentScenario-1419611542</nova:project>
Aug 26 17:51:41 user nova-compute[73110]:       </nova:owner>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:51:41 user nova-compute[73110]:       <nova:ports>
Aug 26 17:51:41 user nova-compute[73110]:         <nova:port uuid="162d41c7-3306-486e-8780-d73a62ab91bb">
Aug 26 17:51:41 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:51:41 user nova-compute[73110]:         </nova:port>
Aug 26 17:51:41 user nova-compute[73110]:       </nova:ports>
Aug 26 17:51:41 user nova-compute[73110]:     </nova:instance>
Aug 26 17:51:41 user nova-compute[73110]:   </metadata>
Aug 26 17:51:41 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:51:41 user nova-compute[73110]:     <system>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="serial">8098e997-fdb1-43ee-bb8a-bed248e3461e</entry>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="uuid">8098e997-fdb1-43ee-bb8a-bed248e3461e</entry>
Aug 26 17:51:41 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:51:41 user nova-compute[73110]:     </system>
Aug 26 17:51:41 user nova-compute[73110]:   </sysinfo>
Aug 26 17:51:41 user nova-compute[73110]:   <os>
Aug 26 17:51:41 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:51:41 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:51:41 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:51:41 user nova-compute[73110]:   </os>
Aug 26 17:51:41 user nova-compute[73110]:   <features>
Aug 26 17:51:41 user nova-compute[73110]:     <acpi/>
Aug 26 17:51:41 user nova-compute[73110]:     <apic/>
Aug 26 17:51:41 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:51:41 user nova-compute[73110]:   </features>
Aug 26 17:51:41 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:51:41 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:51:41 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:51:41 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:51:41 user nova-compute[73110]:   </clock>
Aug 26 17:51:41 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:51:41 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:51:41 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:51:41 user nova-compute[73110]:   </cpu>
Aug 26 17:51:41 user nova-compute[73110]:   <devices>
Aug 26 17:51:41 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:51:41 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:51:41 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk"/>
Aug 26 17:51:41 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:51:41 user nova-compute[73110]:     </disk>
Aug 26 17:51:41 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:51:41 user nova-compute[73110]:       <mac address="fa:16:3e:6d:82:ce"/>
Aug 26 17:51:41 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:51:41 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:51:41 user nova-compute[73110]:       <target dev="tap162d41c7-33"/>
Aug 26 17:51:41 user nova-compute[73110]:     </interface>
Aug 26 17:51:41 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:51:41 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/console.log" append="off"/>
Aug 26 17:51:41 user nova-compute[73110]:     </serial>
Aug 26 17:51:41 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:51:41 user nova-compute[73110]:     <video>
Aug 26 17:51:41 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:51:41 user nova-compute[73110]:     </video>
Aug 26 17:51:41 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:51:41 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:51:41 user nova-compute[73110]:     </rng>
Aug 26 17:51:41 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:51:41 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:51:41 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:51:41 user nova-compute[73110]:     </memballoon>
Aug 26 17:51:41 user nova-compute[73110]:   </devices>
Aug 26 17:51:41 user nova-compute[73110]: </domain>
Aug 26 17:51:41 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-173549576',display_name='tempest-TestServerVolumeAttachmentScenario-server-173549576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-173549576',id=26,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNihgUwani/QMOMlPugJBwlSifpEiGkiiCbxsycbgYwnMmHui5cy3PkVZhMDU5oethM53LfYoKm0ceKAyXdBTAERdIRIbCLt0eZkwS+N+K4kCEbK7VkkydpGHNlwg7HD9w==',key_name='tempest-keypair-937206110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10eea5ee4c32437db9430b6acd32b6f9',ramdisk_id='',reservation_id='r-l01qhooa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1419611542',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1419611542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c0042b00f44f28bfa5ef33f17da542',uuid=8098e997-fdb1-43ee-bb8a-bed248e3461e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converting VIF {"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG os_vif [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap162d41c7-33, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap162d41c7-33, col_values=(('external_ids', {'iface-id': '162d41c7-3306-486e-8780-d73a62ab91bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:82:ce', 'vm-uuid': '8098e997-fdb1-43ee-bb8a-bed248e3461e'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:41 user nova-compute[73110]: INFO os_vif [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33')
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:51:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No VIF found with MAC fa:16:3e:6d:82:ce, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:51:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updated VIF entry in instance network info cache for port 162d41c7-3306-486e-8780-d73a62ab91bb. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:51:42 user nova-compute[73110]: DEBUG nova.network.neutron [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating instance_info_cache with network_info: [{"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3ed150c4-209c-463d-be5a-b7107554995a req-1ade1154-3b23-4eaa-abc6-50b0fc906d5d service nova] Releasing lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] No waiting events found dispatching network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:43 user nova-compute[73110]: WARNING nova.compute.manager [req-204e4323-8323-4079-aeaa-84f6676bcf25 req-b222a115-0453-41a1-ac65-f9facfb0e6a2 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received unexpected event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb for instance with vm_state building and task_state spawning.
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072305.1544323, 8098e997-fdb1-43ee-bb8a-bed248e3461e => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] VM Resumed (Lifecycle Event)
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Instance spawned successfully.
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072305.1563666, 8098e997-fdb1-43ee-bb8a-bed248e3461e => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] VM Started (Lifecycle Event)
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:45 user nova-compute[73110]: INFO nova.compute.manager [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Took 6.50 seconds to build instance.
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] No waiting events found dispatching network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:45 user nova-compute[73110]: WARNING nova.compute.manager [req-0707b60d-b235-4dfd-a98c-a05d2b77615c req-b890bc28-7b71-47cb-8cb7-2e67c0e54d21 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received unexpected event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb for instance with vm_state active and task_state None.
Aug 26 17:51:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-00470f6c-733f-451a-9955-4310ee8876e5 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.624s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:49 user nova-compute[73110]: INFO nova.compute.manager [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Terminating instance
Aug 26 17:51:49 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG nova.compute.manager [req-700b5849-2eb4-4b43-b1c3-97fb74807ca5 req-9253d9ff-dad5-405f-8ccb-ec5a001f1a28 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Instance destroyed successfully.
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'resources' on Instance uuid e277fb69-1fba-42da-98f6-7b55b892788e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2001790373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2001790373',id=15,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiQhqTDtKrFX1L/2k2BPbeFPcIx9Dqv0wygQtrma1XCnxRE2QRpxl/L3gRfi7ZNWt9BNE+kb42vyxBj9a2nDWN8/Og4gyoZy2aQUo+1M1nags1woJmceUS+SEb9dtSGPA==',key_name='tempest-keypair-1356496581',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:49:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-0hw81ljv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e277fb69-1fba-42da-98f6-7b55b892788e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "address": "fa:16:3e:9c:62:e1", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022f585c-5c", "ovs_interfaceid": "022f585c-5ca8-414c-b0cd-59c98b2f1254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG os_vif [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap022f585c-5c, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:51:50 user nova-compute[73110]: INFO os_vif [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:62:e1,bridge_name='br-int',has_traffic_filtering=True,id=022f585c-5ca8-414c-b0cd-59c98b2f1254,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022f585c-5c')
Aug 26 17:51:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Deleting instance files /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e_del
Aug 26 17:51:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Deletion of /opt/stack/data/nova/instances/e277fb69-1fba-42da-98f6-7b55b892788e_del complete
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: INFO nova.compute.manager [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 17:51:50 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072296.221088, db7fad40-12ca-494e-a6e6-f47dd66890c2 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:51:51 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] VM Stopped (Lifecycle Event)
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b0decbfe-4500-4ce0-9e36-a9932a464f57 None None] [instance: db7fad40-12ca-494e-a6e6-f47dd66890c2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:51 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Took 1.17 seconds to deallocate network for instance.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-984b1174-696c-4e2a-afb2-5b708696406f req-da1d2930-1760-4c3b-94cd-c25ebe19e754 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-deleted-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:51 user nova-compute[73110]: WARNING nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state deleted and task_state None.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:51 user nova-compute[73110]: WARNING nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state deleted and task_state None.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:51 user nova-compute[73110]: WARNING nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state deleted and task_state None.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:51 user nova-compute[73110]: WARNING nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-unplugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state deleted and task_state None.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Acquiring lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] Lock "e277fb69-1fba-42da-98f6-7b55b892788e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:51 user nova-compute[73110]: DEBUG nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] No waiting events found dispatching network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:51:51 user nova-compute[73110]: WARNING nova.compute.manager [req-c0b66fc8-55a8-484c-a218-4144c8cebf69 req-b4a5630f-a0e1-421b-b881-9fed94068113 service nova] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Received unexpected event network-vif-plugged-022f585c-5ca8-414c-b0cd-59c98b2f1254 for instance with vm_state deleted and task_state None.
Aug 26 17:51:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:52 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Deleted allocations for instance e277fb69-1fba-42da-98f6-7b55b892788e
Aug 26 17:51:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0ef64a5-f0c6-4297-8d9b-5a16c2a5fb8c tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e277fb69-1fba-42da-98f6-7b55b892788e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.212s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:51:57 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:51:57 user nova-compute[73110]: INFO nova.compute.claims [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Claim successful on node user
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:51:58 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:51:58 user nova-compute[73110]: INFO nova.virt.block_device [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Booting with volume f8730888-1a17-4030-beb2-0d1184cc496f at /dev/vda
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.policy [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c351654543af4a9a86d72d041fcaacb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8688c8465f324c4a9196980792b35718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.utils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6b900-ab1c-4ed6-8339-f120d89ca2be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9855d43-c194-4a47-83f1-7c591345c5c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd067c2-181a-49f3-9ba0-a30ae87a1986]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f5278-5fc2-4f52-9550-b6821d8c6df8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:51:58 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f3a489-a7ef-4b89-b9e5-b7f6c833b50b]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG os_brick.utils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating existing volume attachment record: 0d72f194-43c7-49ae-a73e-2705d6c54bdb {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [{"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-f7c61d60-b862-475f-84cd-bf03501890b0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:51:58 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:51:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:52:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Successfully created port: a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Successfully updated port: a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-changed-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Refreshing instance network info cache due to event network-changed-a6f423aa-51c7-43ad-aa8f-455e4a8e7492. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance network_info: |[{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG nova.network.neutron [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Refreshing network info cache for port a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updated VIF entry in instance network info cache for port a6f423aa-51c7-43ad-aa8f-455e4a8e7492. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bbf955ab-17a1-48b9-9394-87e66d55c43d req-9e484e1e-a208-4b33-ba22-c25027606165 service nova] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072310.0206552, e277fb69-1fba-42da-98f6-7b55b892788e => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:05 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] VM Stopped (Lifecycle Event)
Aug 26 17:52:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:05 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:05 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.34305191040039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-17795d68-f0ca-4fa9-977d-9a2ea7933c9a None None] [instance: e277fb69-1fba-42da-98f6-7b55b892788e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8098e997-fdb1-43ee-bb8a-bed248e3461e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:52:05 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:52:06 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:52:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:52:10 user nova-compute[73110]: INFO nova.compute.claims [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Claim successful on node user
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:52:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:52:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.policy [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b760f93150047f2b46656642fe57efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9df13541045f0b8baace5322a08c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:52:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Creating image(s)
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:52:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Creating image(s)
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Ensure instance console log exists: /opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start _get_guest_xml network_info=[{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0d72f194-43c7-49ae-a73e-2705d6c54bdb', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2936d04-aa73-49cc-975e-f2f9d1e44f75', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8730888-1a17-4030-beb2-0d1184cc496f', 'serial': 'f8730888-1a17-4030-beb2-0d1184cc496f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:11 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbd7089-6dec-4c83-b521-336697d05713]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:52:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db531a-af4e-4931-81b6-0aa610496b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f] added
Aug 26 17:52:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d5440e-56c5-460e-9288-f39b997ea6b1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.229s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71576c-6ebe-498c-a08f-aaafb4db5c77]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVenCwEL {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk 1073741824" returned: 0 in 0.060s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVenCwEL" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2c27f-5f3d-4abf-af74-087559ca2f79]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVenCwEL'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2bd6d-8af6-4200-bfde-b537ce69285b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0498f1-b5dc-4f2d-97c2-c702de89d73c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:52:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:52:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:52:11 user nova-compute[73110]: 
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803130a-e452-4253-a5ed-22eae70ba45a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]
Aug 26 17:52:11 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.
Aug 26 17:52:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e42c49-f92d-4f25-9fe0-2a47e63ccf0d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Successfully created port: 5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dfe148-8587-4acf-b958-0222fae4faa1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea957072-c32c-4163-94dd-aa98bebc3a3d]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:52:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Cannot resize image /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Ensure instance console log exists: /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:52:12 user nova-compute[73110]: INFO nova.compute.claims [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Claim successful on node user
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:52:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.policy [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13ea1c4380894411a8b9778eb9b6806e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e63550f0d24295895234e2c6b33b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:52:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Creating image(s)
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "/opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "/opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "/opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23134333061393165', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134333061393165', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Successfully updated port: 5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquired lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'pci_devices' on Instance uuid f2936d04-aa73-49cc-975e-f2f9d1e44f75 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-changed-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Refreshing instance network info cache due to event network-changed-5bf45c54-92e1-4481-91d2-3edcb6c43948. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] Acquiring lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:13 user nova-compute[73110]:   <uuid>f2936d04-aa73-49cc-975e-f2f9d1e44f75</uuid>
Aug 26 17:52:13 user nova-compute[73110]:   <name>instance-0000001b</name>
Aug 26 17:52:13 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:13 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:13 user nova-compute[73110]:   <metadata>
Aug 26 17:52:13 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:13 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherA-server-1570540143</nova:name>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:11</nova:creationTime>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:13 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:user uuid="c351654543af4a9a86d72d041fcaacb4">tempest-ServerActionsTestOtherA-1020251450-project-member</nova:user>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:project uuid="8688c8465f324c4a9196980792b35718">tempest-ServerActionsTestOtherA-1020251450</nova:project>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:port uuid="a6f423aa-51c7-43ad-aa8f-455e4a8e7492">
Aug 26 17:52:13 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:52:13 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:13 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:13 user nova-compute[73110]:   </metadata>
Aug 26 17:52:13 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:13 user nova-compute[73110]:     <system>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="serial">f2936d04-aa73-49cc-975e-f2f9d1e44f75</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="uuid">f2936d04-aa73-49cc-975e-f2f9d1e44f75</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:13 user nova-compute[73110]:     </system>
Aug 26 17:52:13 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:13 user nova-compute[73110]:   <os>
Aug 26 17:52:13 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:13 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:52:13 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:13 user nova-compute[73110]:   </os>
Aug 26 17:52:13 user nova-compute[73110]:   <features>
Aug 26 17:52:13 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:13 user nova-compute[73110]:     <apic/>
Aug 26 17:52:13 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:13 user nova-compute[73110]:   </features>
Aug 26 17:52:13 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:13 user nova-compute[73110]:   </clock>
Aug 26 17:52:13 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:13 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:13 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:13 user nova-compute[73110]:   </cpu>
Aug 26 17:52:13 user nova-compute[73110]:   <devices>
Aug 26 17:52:13 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:52:13 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:13 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:52:13 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:       <serial>f8730888-1a17-4030-beb2-0d1184cc496f</serial>
Aug 26 17:52:13 user nova-compute[73110]:     </disk>
Aug 26 17:52:13 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:13 user nova-compute[73110]:       <mac address="fa:16:3e:a8:17:79"/>
Aug 26 17:52:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:13 user nova-compute[73110]:       <target dev="tapa6f423aa-51"/>
Aug 26 17:52:13 user nova-compute[73110]:     </interface>
Aug 26 17:52:13 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:13 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75/console.log" append="off"/>
Aug 26 17:52:13 user nova-compute[73110]:     </serial>
Aug 26 17:52:13 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:13 user nova-compute[73110]:     <video>
Aug 26 17:52:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:     </video>
Aug 26 17:52:13 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:13 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:13 user nova-compute[73110]:     </rng>
Aug 26 17:52:13 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:13 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:13 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:13 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:13 user nova-compute[73110]:   </devices>
Aug 26 17:52:13 user nova-compute[73110]: </domain>
Aug 26 17:52:13 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG os_vif [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6f423aa-51, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6f423aa-51, col_values=(('external_ids', {'iface-id': 'a6f423aa-51c7-43ad-aa8f-455e4a8e7492', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:17:79', 'vm-uuid': 'f2936d04-aa73-49cc-975e-f2f9d1e44f75'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: INFO os_vif [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51')
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:a8:17:79, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk 1073741824" returned: 0 in 0.065s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updating instance_info_cache with network_info: [{"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Releasing lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Instance network_info: |[{"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] Acquired lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Refreshing network info cache for port 5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Start _get_guest_xml network_info=[{"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-57748258',display_name='tempest-AttachVolumeNegativeTest-server-57748258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-57748258',id=28,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhAKexQiJik1qh/Mcx3HKKQJOnqN9zavhM8q48zmI2ZPQT2F7FlQP6X59LXeRUJBn/HYkJPy1lIwnqJOm3YIvWXCsUzo0nOxZ6VHNMIAWgMcDISGS8krvKEscSlrfA3+Q==',key_name='tempest-keypair-1924754888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-v5i4gil3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=dd10926b-26ae-4ae3-91f0-26ac2e261c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'pci_devices' on Instance uuid dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:13 user nova-compute[73110]:   <uuid>dd10926b-26ae-4ae3-91f0-26ac2e261c51</uuid>
Aug 26 17:52:13 user nova-compute[73110]:   <name>instance-0000001c</name>
Aug 26 17:52:13 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:13 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:13 user nova-compute[73110]:   <metadata>
Aug 26 17:52:13 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:13 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeNegativeTest-server-57748258</nova:name>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:13</nova:creationTime>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:13 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:user uuid="3b760f93150047f2b46656642fe57efc">tempest-AttachVolumeNegativeTest-650369-project-member</nova:user>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:project uuid="d0d9df13541045f0b8baace5322a08c4">tempest-AttachVolumeNegativeTest-650369</nova:project>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:52:13 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:13 user nova-compute[73110]:         <nova:port uuid="5bf45c54-92e1-4481-91d2-3edcb6c43948">
Aug 26 17:52:13 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 17:52:13 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:13 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:13 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:13 user nova-compute[73110]:   </metadata>
Aug 26 17:52:13 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:13 user nova-compute[73110]:     <system>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="serial">dd10926b-26ae-4ae3-91f0-26ac2e261c51</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="uuid">dd10926b-26ae-4ae3-91f0-26ac2e261c51</entry>
Aug 26 17:52:13 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:13 user nova-compute[73110]:     </system>
Aug 26 17:52:13 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:13 user nova-compute[73110]:   <os>
Aug 26 17:52:13 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:13 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:52:13 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:13 user nova-compute[73110]:   </os>
Aug 26 17:52:13 user nova-compute[73110]:   <features>
Aug 26 17:52:13 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:13 user nova-compute[73110]:     <apic/>
Aug 26 17:52:13 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:13 user nova-compute[73110]:   </features>
Aug 26 17:52:13 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:13 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:13 user nova-compute[73110]:   </clock>
Aug 26 17:52:13 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:13 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:13 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:13 user nova-compute[73110]:   </cpu>
Aug 26 17:52:13 user nova-compute[73110]:   <devices>
Aug 26 17:52:13 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:52:13 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:52:13 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk"/>
Aug 26 17:52:13 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:     </disk>
Aug 26 17:52:13 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:13 user nova-compute[73110]:       <mac address="fa:16:3e:59:db:da"/>
Aug 26 17:52:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:13 user nova-compute[73110]:       <target dev="tap5bf45c54-92"/>
Aug 26 17:52:13 user nova-compute[73110]:     </interface>
Aug 26 17:52:13 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:13 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/console.log" append="off"/>
Aug 26 17:52:13 user nova-compute[73110]:     </serial>
Aug 26 17:52:13 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:13 user nova-compute[73110]:     <video>
Aug 26 17:52:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:13 user nova-compute[73110]:     </video>
Aug 26 17:52:13 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:13 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:13 user nova-compute[73110]:     </rng>
Aug 26 17:52:13 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:13 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:13 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:13 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:13 user nova-compute[73110]:   </devices>
Aug 26 17:52:13 user nova-compute[73110]: </domain>
Aug 26 17:52:13 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-57748258',display_name='tempest-AttachVolumeNegativeTest-server-57748258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-57748258',id=28,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhAKexQiJik1qh/Mcx3HKKQJOnqN9zavhM8q48zmI2ZPQT2F7FlQP6X59LXeRUJBn/HYkJPy1lIwnqJOm3YIvWXCsUzo0nOxZ6VHNMIAWgMcDISGS8krvKEscSlrfA3+Q==',key_name='tempest-keypair-1924754888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-v5i4gil3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=dd10926b-26ae-4ae3-91f0-26ac2e261c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG os_vif [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bf45c54-92, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bf45c54-92, col_values=(('external_ids', {'iface-id': '5bf45c54-92e1-4481-91d2-3edcb6c43948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:db:da', 'vm-uuid': 'dd10926b-26ae-4ae3-91f0-26ac2e261c51'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Successfully created port: 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:13 user nova-compute[73110]: INFO os_vif [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92')
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:59:db:da, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Cannot resize image /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Ensure instance console log exists: /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updated VIF entry in instance network info cache for port 5bf45c54-92e1-4481-91d2-3edcb6c43948. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updating instance_info_cache with network_info: [{"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7f9db9d4-eadc-4a7e-a119-55656c9ee765 req-e005cbec-b9d0-4265-93bd-dc5725bd89bd service nova] Releasing lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Successfully updated port: 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquired lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-changed-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Refreshing instance network info cache due to event network-changed-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] Acquiring lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updating instance_info_cache with network_info: [{"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Releasing lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Instance network_info: |[{"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] Acquired lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Refreshing network info cache for port 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Start _get_guest_xml network_info=[{"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4363093',id=29,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoivKwr2FJtWV5yZUy1o6nhhTuEs4P6lCvOQtAktG/pN4t19Bp+VpYHmV7GLZmm0Aw9AvlCtpUvEr2CNfRzUnabtNvbv2cjeUE166RcTYyzmxUQFR3UveUCdce1woWmOw==',key_name='tempest-keypair-1128981195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9e63550f0d24295895234e2c6b33b12',ramdisk_id='',reservation_id='r-5nxsojgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13ea1c4380894411a8b9778eb9b6806e',uuid=e932a3e8-97ac-4775-aa60-c09f9d6d079f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converting VIF {"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lazy-loading 'pci_devices' on Instance uuid e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:14 user nova-compute[73110]:   <uuid>e932a3e8-97ac-4775-aa60-c09f9d6d079f</uuid>
Aug 26 17:52:14 user nova-compute[73110]:   <name>instance-0000001d</name>
Aug 26 17:52:14 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:14 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:14 user nova-compute[73110]:   <metadata>
Aug 26 17:52:14 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:14 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372</nova:name>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:14</nova:creationTime>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:14 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:14 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:user uuid="13ea1c4380894411a8b9778eb9b6806e">tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member</nova:user>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:project uuid="b9e63550f0d24295895234e2c6b33b12">tempest-TestServerVolumeAttachScenarioOldVersion-668987731</nova:project>
Aug 26 17:52:14 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:52:14 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:14 user nova-compute[73110]:         <nova:port uuid="11c3ae4c-cd97-4427-b2a4-ca9030f28e2f">
Aug 26 17:52:14 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 17:52:14 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:14 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:14 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:14 user nova-compute[73110]:   </metadata>
Aug 26 17:52:14 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:14 user nova-compute[73110]:     <system>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="serial">e932a3e8-97ac-4775-aa60-c09f9d6d079f</entry>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="uuid">e932a3e8-97ac-4775-aa60-c09f9d6d079f</entry>
Aug 26 17:52:14 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:14 user nova-compute[73110]:     </system>
Aug 26 17:52:14 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:14 user nova-compute[73110]:   <os>
Aug 26 17:52:14 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:14 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:52:14 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:14 user nova-compute[73110]:   </os>
Aug 26 17:52:14 user nova-compute[73110]:   <features>
Aug 26 17:52:14 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:14 user nova-compute[73110]:     <apic/>
Aug 26 17:52:14 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:14 user nova-compute[73110]:   </features>
Aug 26 17:52:14 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:14 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:14 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:14 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:14 user nova-compute[73110]:   </clock>
Aug 26 17:52:14 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:14 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:14 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:14 user nova-compute[73110]:   </cpu>
Aug 26 17:52:14 user nova-compute[73110]:   <devices>
Aug 26 17:52:14 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:52:14 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:52:14 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk"/>
Aug 26 17:52:14 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:14 user nova-compute[73110]:     </disk>
Aug 26 17:52:14 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:14 user nova-compute[73110]:       <mac address="fa:16:3e:e0:83:3e"/>
Aug 26 17:52:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:14 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:14 user nova-compute[73110]:       <target dev="tap11c3ae4c-cd"/>
Aug 26 17:52:14 user nova-compute[73110]:     </interface>
Aug 26 17:52:14 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:14 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/console.log" append="off"/>
Aug 26 17:52:14 user nova-compute[73110]:     </serial>
Aug 26 17:52:14 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:14 user nova-compute[73110]:     <video>
Aug 26 17:52:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:14 user nova-compute[73110]:     </video>
Aug 26 17:52:14 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:14 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:14 user nova-compute[73110]:     </rng>
Aug 26 17:52:14 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:14 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:14 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:14 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:14 user nova-compute[73110]:   </devices>
Aug 26 17:52:14 user nova-compute[73110]: </domain>
Aug 26 17:52:14 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4363093',id=29,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoivKwr2FJtWV5yZUy1o6nhhTuEs4P6lCvOQtAktG/pN4t19Bp+VpYHmV7GLZmm0Aw9AvlCtpUvEr2CNfRzUnabtNvbv2cjeUE166RcTYyzmxUQFR3UveUCdce1woWmOw==',key_name='tempest-keypair-1128981195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9e63550f0d24295895234e2c6b33b12',ramdisk_id='',reservation_id='r-5nxsojgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13ea1c4380894411a8b9778eb9b6806e',uuid=e932a3e8-97ac-4775-aa60-c09f9d6d079f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converting VIF {"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG os_vif [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11c3ae4c-cd, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11c3ae4c-cd, col_values=(('external_ids', {'iface-id': '11c3ae4c-cd97-4427-b2a4-ca9030f28e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:83:3e', 'vm-uuid': 'e932a3e8-97ac-4775-aa60-c09f9d6d079f'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:14 user nova-compute[73110]: INFO os_vif [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd')
Aug 26 17:52:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] No VIF found with MAC fa:16:3e:e0:83:3e, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updated VIF entry in instance network info cache for port 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updating instance_info_cache with network_info: [{"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9a91d6ad-445b-4464-91f7-a6f3abc2fd91 req-cd2e6d9d-008a-4170-8578-bf919186196b service nova] Releasing lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: INFO nova.compute.manager [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Rescuing
Aug 26 17:52:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] No waiting events found dispatching network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:16 user nova-compute[73110]: WARNING nova.compute.manager [req-175331bd-c8b3-4f63-b780-c526beca4712 req-61348313-d27e-42c3-ae65-befa4746bfdc service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received unexpected event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 for instance with vm_state building and task_state spawning.
Aug 26 17:52:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:17 user nova-compute[73110]: WARNING nova.compute.manager [req-ac9c03f5-93e0-4682-a1e4-6e312d1ab59a req-13342521-955a-4fba-8dd5-a7b19cd8338b service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state active and task_state rescuing.
Aug 26 17:52:17 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance destroyed successfully.
Aug 26 17:52:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Attempting rescue
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:52:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Creating image(s)
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'trusted_certs' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.243s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue" returned: 0 in 0.052s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'migration_context' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<573d5b76-ace4-471a-a1d4-5a770389d14f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start _get_guest_xml network_info=[{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:16:dc:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<573d5b76-ace4-471a-a1d4-5a770389d14f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'numa_topology' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<573d5b76-ace4-471a-a1d4-5a770389d14f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'vcpu_model' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<573d5b76-ace4-471a-a1d4-5a770389d14f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2123724910',display_name='tempest-ServerRescueNegativeTestJSON-server-2123724910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2123724910',id=24,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-y2ex1qea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:34Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=573d5b76-ace4-471a-a1d4-5a770389d14f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:16:dc:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:16:dc:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.objects.base [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<573d5b76-ace4-471a-a1d4-5a770389d14f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:18 user nova-compute[73110]:   <uuid>573d5b76-ace4-471a-a1d4-5a770389d14f</uuid>
Aug 26 17:52:18 user nova-compute[73110]:   <name>instance-00000018</name>
Aug 26 17:52:18 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:18 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:18 user nova-compute[73110]:   <metadata>
Aug 26 17:52:18 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:18 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2123724910</nova:name>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:18</nova:creationTime>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:18 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:18 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 17:52:18 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:52:18 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:18 user nova-compute[73110]:         <nova:port uuid="e4282f7b-d25a-40b4-b583-108158205f46">
Aug 26 17:52:18 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 17:52:18 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:18 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:18 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:18 user nova-compute[73110]:   </metadata>
Aug 26 17:52:18 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:18 user nova-compute[73110]:     <system>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="serial">573d5b76-ace4-471a-a1d4-5a770389d14f</entry>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="uuid">573d5b76-ace4-471a-a1d4-5a770389d14f</entry>
Aug 26 17:52:18 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:18 user nova-compute[73110]:     </system>
Aug 26 17:52:18 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:18 user nova-compute[73110]:   <os>
Aug 26 17:52:18 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:18 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:18 user nova-compute[73110]:   </os>
Aug 26 17:52:18 user nova-compute[73110]:   <features>
Aug 26 17:52:18 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:18 user nova-compute[73110]:     <apic/>
Aug 26 17:52:18 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:18 user nova-compute[73110]:   </features>
Aug 26 17:52:18 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:18 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:18 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:18 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:18 user nova-compute[73110]:   </clock>
Aug 26 17:52:18 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:18 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:18 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:18 user nova-compute[73110]:   </cpu>
Aug 26 17:52:18 user nova-compute[73110]:   <devices>
Aug 26 17:52:18 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:52:18 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:52:18 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue"/>
Aug 26 17:52:18 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:18 user nova-compute[73110]:     </disk>
Aug 26 17:52:18 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:52:18 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:52:18 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk"/>
Aug 26 17:52:18 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:52:18 user nova-compute[73110]:     </disk>
Aug 26 17:52:18 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:18 user nova-compute[73110]:       <mac address="fa:16:3e:16:dc:2b"/>
Aug 26 17:52:18 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:18 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:18 user nova-compute[73110]:       <target dev="tape4282f7b-d2"/>
Aug 26 17:52:18 user nova-compute[73110]:     </interface>
Aug 26 17:52:18 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:18 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/console.log" append="off"/>
Aug 26 17:52:18 user nova-compute[73110]:     </serial>
Aug 26 17:52:18 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:18 user nova-compute[73110]:     <video>
Aug 26 17:52:18 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:18 user nova-compute[73110]:     </video>
Aug 26 17:52:18 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:18 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:18 user nova-compute[73110]:     </rng>
Aug 26 17:52:18 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:18 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:18 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:18 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:18 user nova-compute[73110]:   </devices>
Aug 26 17:52:18 user nova-compute[73110]: </domain>
Aug 26 17:52:18 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance destroyed successfully.
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:16:dc:2b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] No waiting events found dispatching network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.compute.manager [req-13c49e59-b65b-4b3a-a024-753ecf0110d0 req-5290fbae-249f-446f-944a-224e175b399b service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received unexpected event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f for instance with vm_state building and task_state spawning.
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] No waiting events found dispatching network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received unexpected event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 for instance with vm_state building and task_state spawning.
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state building and task_state spawning.
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:18 user nova-compute[73110]: WARNING nova.compute.manager [req-a0f81e48-62a7-48b8-8251-49d2f3bc3e7e req-d2254572-8470-4b0c-a724-337fcf039d07 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state building and task_state spawning.
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:19 user nova-compute[73110]: WARNING nova.compute.manager [req-a069d567-acc8-4980-bd63-a8dcde4ea461 req-531ebc8f-7bef-4a99-b6e3-702631872945 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state active and task_state rescuing.
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072339.927791, dd10926b-26ae-4ae3-91f0-26ac2e261c51 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] VM Resumed (Lifecycle Event)
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:52:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Instance spawned successfully.
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072339.9280086, dd10926b-26ae-4ae3-91f0-26ac2e261c51 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] VM Started (Lifecycle Event)
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Took 9.01 seconds to spawn the instance on the hypervisor.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Took 9.92 seconds to build instance.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-217c92b1-0e15-4699-b9a0-bc7bc0985050 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.057s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072340.4371383, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Resumed (Lifecycle Event)
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance spawned successfully.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072340.45234, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Started (Lifecycle Event)
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Took 9.30 seconds to spawn the instance on the hypervisor.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] No waiting events found dispatching network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:20 user nova-compute[73110]: WARNING nova.compute.manager [req-0806a8fd-1071-4987-b372-3ddf08995189 req-e55f8ae4-8479-4b97-8a69-4a2e9179e9eb service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received unexpected event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f for instance with vm_state building and task_state spawning.
Aug 26 17:52:20 user nova-compute[73110]: INFO nova.compute.manager [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Took 23.25 seconds to build instance.
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-80dd2a81-1808-43e0-ba6f-ef12f4bd0437 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.382s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:52:21 user nova-compute[73110]: INFO nova.compute.claims [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Claim successful on node user
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:21 user nova-compute[73110]: WARNING nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state active and task_state rescuing.
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:21 user nova-compute[73110]: WARNING nova.compute.manager [req-0373b2f6-6cc3-4f54-91eb-fe75cd631322 req-40b32a91-babb-409e-ab4b-846327d3b374 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state active and task_state rescuing.
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:52:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:52:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.virt.block_device [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Booting with blank volume at /dev/vda
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072342.006802, e932a3e8-97ac-4775-aa60-c09f9d6d079f => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] VM Resumed (Lifecycle Event)
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.policy [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '095465fef30b4fd0a144cb5b7c4ffb7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef6ddc676bd48e4886079097e3e0d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Instance spawned successfully.
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072342.02025, e932a3e8-97ac-4775-aa60-c09f9d6d079f => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] VM Started (Lifecycle Event)
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Took 9.23 seconds to spawn the instance on the hypervisor.
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Took 10.13 seconds to build instance.
Aug 26 17:52:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f84ca298-cc92-479f-938f-cbf9bb408903 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.285s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Successfully created port: 1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 573d5b76-ace4-471a-a1d4-5a770389d14f due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072342.9166472, 573d5b76-ace4-471a-a1d4-5a770389d14f => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:22 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] VM Resumed (Lifecycle Event)
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0bff7e1f-fc67-4589-a02f-1254deb819aa tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072342.919624, 573d5b76-ace4-471a-a1d4-5a770389d14f => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] VM Started (Lifecycle Event)
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Successfully updated port: 1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-changed-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Refreshing instance network info cache due to event network-changed-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:23 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance network_info: |[{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Refreshing network info cache for port 1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:24 user nova-compute[73110]: INFO nova.compute.manager [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attaching volume ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 to /dev/vdb
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.utils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3bcd9c-cf63-4d06-bd54-56ee18fd85b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3c1a2f-b6ce-4e18-a7a3-a3e1b0c854fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82985e4-6411-44ee-a41b-49e739b29d00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb08a2-e1c3-4278-a26f-109084c9e949]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updated VIF entry in instance network info cache for port 1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:24 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b4639-0197-46c5-8d9e-13c57eed9c85]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG os_brick.utils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating existing volume attachment record: 26c269a3-8cbf-4083-a79c-1bccfe2b2ff0 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-75e2526f-aaf5-4506-95d1-a211b672c0f0 req-d14a8d0f-401f-40b0-9997-200fcf579bf6 service nova] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.utils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a4741-d8a6-42fa-ad85-173cf018fe3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da5783e-8990-4c76-98c4-6222cd03c4ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[85604904-9e67-44c6-9587-79813edc28da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117091a-d01b-4424-bfb9-a4b135c545fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:27 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:52:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[40613e06-162e-4dee-9caf-64bf21ce5c06]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG os_brick.utils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:27 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating existing volume attachment record: 65ebf20f-dc07-43dc-b7ee-e5c5093167b3 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:52:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-changed-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Refreshing instance network info cache due to event network-changed-b98feb61-a4ce-4b66-9591-45b7fe149266. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] Acquiring lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] Acquired lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:37 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Refreshing network info cache for port b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updated VIF entry in instance network info cache for port b98feb61-a4ce-4b66-9591-45b7fe149266. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating instance_info_cache with network_info: [{"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c84f010-a331-4d66-b3e4-3441c6f37bfc req-b86baaa2-5907-4012-ae8a-e76ffc93d82f service nova] Releasing lock "refresh_cache-6a04afc7-0fe6-496a-97cb-9bf275b53da4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaxIrjUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:38 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:38 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:38 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[432989be-e98d-4871-a540-f7e12603b053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:52:38 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb597e-f1bb-40aa-909a-da28f4ff330c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61] added
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff046cd-fb49-4a93-8db1-67a3ff8d6859]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e80ae-618a-4dd4-9d7d-5503f81e0560]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaxIrjUz {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BaxIrjUz" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb066d-c5aa-42a5-9904-170097434ad5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BaxIrjUz'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[af426647-5ee3-47db-ae42-2d0835244538]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbfbef-e4ac-4272-8eb6-03b14de111db]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e476668-c580-4600-8fb7-5fb0af3fe133]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260]
Aug 26 17:52:38 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260] successful.
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45767ba-8f73-466a-b22d-ed503e860c0c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cafecec-22a3-461c-a767-22493d7eb0f0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:38 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:38 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:38 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9449498d-13d0-4a22-9934-f1a55e6fe40d]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:52:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaxIrjUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26464643865323231', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464643865323231', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:52:39 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:39 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:52:39 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:52:39 user nova-compute[73110]:   <serial>ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61</serial>
Aug 26 17:52:39 user nova-compute[73110]: </disk>
Aug 26 17:52:39 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:52:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] No VIF found with MAC fa:16:3e:19:82:35, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f1fcf360-5c89-4fbf-8f64-e672ec31c7b7 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.602s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:52:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Creating image(s)
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Ensure instance console log exists: /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start _get_guest_xml network_info=[{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '65ebf20f-dc07-43dc-b7ee-e5c5093167b3', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '524fef5b-abfb-4d7d-b14f-eb899fa526d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a32866a6-0913-4afc-abf4-90953ea46e41', 'serial': 'a32866a6-0913-4afc-abf4-90953ea46e41'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:42 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:42 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:42 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9511d62-384c-4b21-a63e-0c40c54aeaff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:52:42 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d351ed-8c0c-49a0-b20f-fafe1b86c308]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41] added
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c3efb6-ec89-47bc-9bfa-1e67c7655e11]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3d538a-e5b5-40b5-96b8-9852ba29c3a2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCQplWMP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCQplWMP" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb12cdb-0464-47ab-87a0-589ccb1beece]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCQplWMP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5d4a4-a84f-4d68-bf10-17a37c178332]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a4729-7636-4b93-9657-2047569c8a58]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.objects.instance [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250cc95-dda7-40dd-b9d9-8832f3c4c19f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260]
Aug 26 17:52:42 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260] successful.
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[73117c2b-d6ee-47c0-bd67-a0521b0be526]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:42 user nova-compute[73110]: INFO nova.compute.manager [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Detaching volume ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8567f-3859-4658-901f-7fcfa1e7b614]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1907191-502c-4d67-b10a-5a1bf9eac0b4]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:52:42 user nova-compute[73110]: INFO nova.virt.block_device [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Attempting to driver detach volume ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 from mountpoint /dev/vdb
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Attempting to detach device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:52:42 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:42 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:52:42 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:52:42 user nova-compute[73110]:   <serial>ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61</serial>
Aug 26 17:52:42 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:52:42 user nova-compute[73110]: </disk>
Aug 26 17:52:42 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:52:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the persistent domain config.
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:52:42 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:42 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:52:42 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:52:42 user nova-compute[73110]:   <serial>ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61</serial>
Aug 26 17:52:42 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:52:42 user nova-compute[73110]: </disk>
Aug 26 17:52:42 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:42 user nova-compute[73110]: INFO nova.compute.manager [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attaching volume 197b0424-7ae3-4b76-ab73-5650ecb35873 to /dev/vdb
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.utils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[398aa630-2e7d-4abd-af12-d7fa03d07510]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d70fff8-4fb0-4657-b8f0-7b4ca38cb76f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ad8c3-5275-4fb7-ab40-4e3704b3cbcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be606aa-b0ea-4f5b-b7cd-f18760518418]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:52:42 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:52:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6dd961-128b-4f73-9cb3-6752d83b2d27]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG os_brick.utils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:42 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating existing volume attachment record: ccc043c7-ecb9-4bc7-9b13-3980750440c0 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072363.0934722, f7c61d60-b862-475f-84cd-bf03501890b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:52:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully detached device vdb from instance f7c61d60-b862-475f-84cd-bf03501890b0 from the live domain config.
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BaxIrjUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:43 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:52:43 user nova-compute[73110]: INFO nova.compute.claims [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Claim successful on node user
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23231643363383261', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231643363383261', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.503s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded8c6b-c7b2-403f-a680-72298712f88f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488928143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488928143',id=30,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-n0nsdvz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:22Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=524fef5b-abfb-4d7d-b14f-eb899fa526d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[208b3fb0-c9fc-4618-9d6f-7336691a3908]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:43 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:43 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:43 user nova-compute[73110]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 (non-flash)
Aug 26 17:52:43 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5640bea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:43 user nova-compute[73110]:   <uuid>524fef5b-abfb-4d7d-b14f-eb899fa526d2</uuid>
Aug 26 17:52:43 user nova-compute[73110]:   <name>instance-0000001e</name>
Aug 26 17:52:43 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:43 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:43 user nova-compute[73110]:   <metadata>
Aug 26 17:52:43 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:43 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1488928143</nova:name>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:42</nova:creationTime>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:43 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:43 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 17:52:43 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:52:43 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:43 user nova-compute[73110]:         <nova:port uuid="1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b">
Aug 26 17:52:43 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:52:43 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:43 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:43 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:43 user nova-compute[73110]:   </metadata>
Aug 26 17:52:43 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:43 user nova-compute[73110]:     <system>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="serial">524fef5b-abfb-4d7d-b14f-eb899fa526d2</entry>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="uuid">524fef5b-abfb-4d7d-b14f-eb899fa526d2</entry>
Aug 26 17:52:43 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:43 user nova-compute[73110]:     </system>
Aug 26 17:52:43 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:43 user nova-compute[73110]:   <os>
Aug 26 17:52:43 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:43 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:52:43 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:43 user nova-compute[73110]:   </os>
Aug 26 17:52:43 user nova-compute[73110]:   <features>
Aug 26 17:52:43 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:43 user nova-compute[73110]:     <apic/>
Aug 26 17:52:43 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:43 user nova-compute[73110]:   </features>
Aug 26 17:52:43 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:43 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:43 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:43 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:43 user nova-compute[73110]:   </clock>
Aug 26 17:52:43 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:43 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:43 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:43 user nova-compute[73110]:   </cpu>
Aug 26 17:52:43 user nova-compute[73110]:   <devices>
Aug 26 17:52:43 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:52:43 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:43 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 17:52:43 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:43 user nova-compute[73110]:       <serial>a32866a6-0913-4afc-abf4-90953ea46e41</serial>
Aug 26 17:52:43 user nova-compute[73110]:     </disk>
Aug 26 17:52:43 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:43 user nova-compute[73110]:       <mac address="fa:16:3e:49:d4:01"/>
Aug 26 17:52:43 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:43 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:43 user nova-compute[73110]:       <target dev="tap1cb298fd-da"/>
Aug 26 17:52:43 user nova-compute[73110]:     </interface>
Aug 26 17:52:43 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:43 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/console.log" append="off"/>
Aug 26 17:52:43 user nova-compute[73110]:     </serial>
Aug 26 17:52:43 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:43 user nova-compute[73110]:     <video>
Aug 26 17:52:43 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:43 user nova-compute[73110]:     </video>
Aug 26 17:52:43 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:43 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:43 user nova-compute[73110]:     </rng>
Aug 26 17:52:43 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:43 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:43 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:43 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:43 user nova-compute[73110]:   </devices>
Aug 26 17:52:43 user nova-compute[73110]: </domain>
Aug 26 17:52:43 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488928143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488928143',id=30,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-n0nsdvz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:22Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=524fef5b-abfb-4d7d-b14f-eb899fa526d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_vif [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb298fd-da, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cb298fd-da, col_values=(('external_ids', {'iface-id': '1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d4:01', 'vm-uuid': '524fef5b-abfb-4d7d-b14f-eb899fa526d2'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee1552d-75e0-4cb2-b5d5-e71369eef23c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:43 user nova-compute[73110]: INFO os_vif [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da')
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19bfe2c-41e3-4b45-9b3b-59a3ff870443]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d6c67f-a5a2-4c5b-ac40-e67ba7ce40c3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76c2e5-0a1c-40c1-aa0d-bc1f4b1e7caa]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:49:d4:01, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c780b2-a3b0-4110-9b44-80d3d457f78d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e56198-dde7-49e6-8e0d-f0ab41ea3a17]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260]
Aug 26 17:52:43 user nova-compute[73110]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61, portal: 172.16.0.220,3260] successful.
Aug 26 17:52:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb5eeda-2ff5-4221-b650-7c7d3e6e8b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403e413-fe83-4b5e-b0cf-ce1260c9710e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] <== disconnect_volume: return (866ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:52:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.policy [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4f2d956017b4782a5db5b60ff5106d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b35bd237a204d0c9f8d3dffbc755653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:52:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Creating image(s)
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk 1073741824" returned: 0 in 0.059s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.objects.instance [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'flavor' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Successfully created port: d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-79e84b4a-0c37-47ab-85cb-b7c2d352c8a4 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.350s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:52:44 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Cannot resize image /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Ensure instance console log exists: /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:45 user nova-compute[73110]: WARNING nova.compute.manager [req-a09e474e-5644-4db9-82ef-4f4532fd4839 req-8aba0e3f-0679-4cbc-9b4f-98d1038db858 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state building and task_state spawning.
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Successfully updated port: d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.neutron [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance network_info: |[{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start _get_guest_xml network_info=[{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:52:46 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:46 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6HGkYJrZgR9RAsJrKbrPa3xXlMGCteSSqFBQEtn32qM+oUFM+geKyJ8jATuAQcl0KqcxyWT8cUf0xA0a1HCUMLXcG21IEboc7r3Zdj0kSYg2pdOqNUcWYI3lmly4UjZQ==',key_name='tempest-keypair-2135638762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_devices' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:52:46 user nova-compute[73110]:   <uuid>e647b330-de37-43ae-a64c-d3fbd03492f9</uuid>
Aug 26 17:52:46 user nova-compute[73110]:   <name>instance-0000001f</name>
Aug 26 17:52:46 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:52:46 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:52:46 user nova-compute[73110]:   <metadata>
Aug 26 17:52:46 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:52:46 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1663823385</nova:name>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:52:46</nova:creationTime>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:52:46 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:52:46 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:owner>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:user uuid="a4f2d956017b4782a5db5b60ff5106d1">tempest-AttachVolumeShelveTestJSON-90237160-project-member</nova:user>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:project uuid="8b35bd237a204d0c9f8d3dffbc755653">tempest-AttachVolumeShelveTestJSON-90237160</nova:project>
Aug 26 17:52:46 user nova-compute[73110]:       </nova:owner>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:52:46 user nova-compute[73110]:       <nova:ports>
Aug 26 17:52:46 user nova-compute[73110]:         <nova:port uuid="d2fab18a-23f0-49bd-b403-3715800f830a">
Aug 26 17:52:46 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 17:52:46 user nova-compute[73110]:         </nova:port>
Aug 26 17:52:46 user nova-compute[73110]:       </nova:ports>
Aug 26 17:52:46 user nova-compute[73110]:     </nova:instance>
Aug 26 17:52:46 user nova-compute[73110]:   </metadata>
Aug 26 17:52:46 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:52:46 user nova-compute[73110]:     <system>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="serial">e647b330-de37-43ae-a64c-d3fbd03492f9</entry>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="uuid">e647b330-de37-43ae-a64c-d3fbd03492f9</entry>
Aug 26 17:52:46 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:52:46 user nova-compute[73110]:     </system>
Aug 26 17:52:46 user nova-compute[73110]:   </sysinfo>
Aug 26 17:52:46 user nova-compute[73110]:   <os>
Aug 26 17:52:46 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:52:46 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:52:46 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:52:46 user nova-compute[73110]:   </os>
Aug 26 17:52:46 user nova-compute[73110]:   <features>
Aug 26 17:52:46 user nova-compute[73110]:     <acpi/>
Aug 26 17:52:46 user nova-compute[73110]:     <apic/>
Aug 26 17:52:46 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:52:46 user nova-compute[73110]:   </features>
Aug 26 17:52:46 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:52:46 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:52:46 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:52:46 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:52:46 user nova-compute[73110]:   </clock>
Aug 26 17:52:46 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:52:46 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:52:46 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:52:46 user nova-compute[73110]:   </cpu>
Aug 26 17:52:46 user nova-compute[73110]:   <devices>
Aug 26 17:52:46 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:52:46 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:52:46 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk"/>
Aug 26 17:52:46 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:52:46 user nova-compute[73110]:     </disk>
Aug 26 17:52:46 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:52:46 user nova-compute[73110]:       <mac address="fa:16:3e:32:62:6b"/>
Aug 26 17:52:46 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:46 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:52:46 user nova-compute[73110]:       <target dev="tapd2fab18a-23"/>
Aug 26 17:52:46 user nova-compute[73110]:     </interface>
Aug 26 17:52:46 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:52:46 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/console.log" append="off"/>
Aug 26 17:52:46 user nova-compute[73110]:     </serial>
Aug 26 17:52:46 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:52:46 user nova-compute[73110]:     <video>
Aug 26 17:52:46 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:52:46 user nova-compute[73110]:     </video>
Aug 26 17:52:46 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:52:46 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:52:46 user nova-compute[73110]:     </rng>
Aug 26 17:52:46 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:52:46 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:52:46 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:52:46 user nova-compute[73110]:     </memballoon>
Aug 26 17:52:46 user nova-compute[73110]:   </devices>
Aug 26 17:52:46 user nova-compute[73110]: </domain>
Aug 26 17:52:46 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6HGkYJrZgR9RAsJrKbrPa3xXlMGCteSSqFBQEtn32qM+oUFM+geKyJ8jATuAQcl0KqcxyWT8cUf0xA0a1HCUMLXcG21IEboc7r3Zdj0kSYg2pdOqNUcWYI3lmly4UjZQ==',key_name='tempest-keypair-2135638762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG os_vif [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2fab18a-23, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2fab18a-23, col_values=(('external_ids', {'iface-id': 'd2fab18a-23f0-49bd-b403-3715800f830a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:62:6b', 'vm-uuid': 'e647b330-de37-43ae-a64c-d3fbd03492f9'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:52:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:46 user nova-compute[73110]: INFO os_vif [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23')
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No VIF found with MAC fa:16:3e:32:62:6b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072367.5672374, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Resumed (Lifecycle Event)
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance spawned successfully.
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:47 user nova-compute[73110]: WARNING nova.compute.manager [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state building and task_state spawning.
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing instance network info cache due to event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072367.5714045, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Started (Lifecycle Event)
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 26 17:52:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:47 user nova-compute[73110]: INFO nova.compute.manager [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Took 26.82 seconds to build instance.
Aug 26 17:52:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6c0f4625-3405-4bf9-af41-e9d89981f1b2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.984s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updated VIF entry in instance network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5ecacb36-d86e-4607-870e-359717ad1aec req-278d8da5-8421-47f3-a973-4ae20b717222 service nova] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:48 user nova-compute[73110]: WARNING nova.compute.manager [req-9ed4acdd-c511-40e4-bd2d-c271318a307d req-a3e44a79-515b-418e-99a8-9835b5ca474e service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state building and task_state spawning.
Aug 26 17:52:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072370.5111651, e647b330-de37-43ae-a64c-d3fbd03492f9 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Resumed (Lifecycle Event)
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance spawned successfully.
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072370.5144322, e647b330-de37-43ae-a64c-d3fbd03492f9 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Started (Lifecycle Event)
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:52:50 user nova-compute[73110]: WARNING nova.compute.manager [req-0e1c6a09-e739-435f-98be-4f55812fcf2d req-22543e9c-4f9a-4fa8-b12b-c4d278d5f2b4 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state building and task_state spawning.
Aug 26 17:52:50 user nova-compute[73110]: INFO nova.compute.manager [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Took 7.43 seconds to build instance.
Aug 26 17:52:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-eeb1d5f9-5266-404d-9a9d-7d987393b0fc tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.547s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZjrcQeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:52:54 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:54 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:52:54 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89dd7b-52a0-4699-b383-5dfcd788b798]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:52:54 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71f3ed9-5a81-4d0e-a696-a1600256a3ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873] added
Aug 26 17:52:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d000216-3d53-4079-a9ba-4a88ed8241f6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f261f34-c29e-4d07-b3b6-93171583262e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZjrcQeG {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZjrcQeG" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3fda9-e132-43de-adc8-7a19a31a17c8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZjrcQeG'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c3d88-a191-49a6-840f-91ee33b16faa]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d320a-6d6a-4696-8848-20c265109470]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be42d4c-4538-414e-a477-d6f95e74fd2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260]
Aug 26 17:52:55 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260] successful.
Aug 26 17:52:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a6ead-d638-45e2-83d5-0d06f76c3dde]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c31cf-3ce4-43b6-9c3b-00ef6e3f7058]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:52:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c620fb-978c-4308-aec9-bc80a76ad5c3]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:52:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZjrcQeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26563376233393632', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563376233393632', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.objects.instance [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:52:56 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:52:56 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:52:56 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:52:56 user nova-compute[73110]:   <serial>197b0424-7ae3-4b76-ab73-5650ecb35873</serial>
Aug 26 17:52:56 user nova-compute[73110]: </disk>
Aug 26 17:52:56 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No VIF found with MAC fa:16:3e:ff:e1:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46aede58-3d72-4b3c-9048-39676f439cfd tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.103s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:52:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:52:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:52:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:53:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:53:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:53:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:03 user nova-compute[73110]: INFO nova.compute.manager [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attaching volume 7b44814f-5afd-42a7-8ac1-735426085b4e to /dev/vdc
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.utils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cc9fb7-d9fa-4cc2-8d84-a77e90cc0704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c1eeb-a28d-4d05-9814-f0d1a5caa610]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c283dc-e0f9-46da-a043-245e88635103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a8ce0-8129-4095-9145-fa1f058950ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:03 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c40bb7-0ddf-4553-a4f8-cebbc0eec244]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG os_brick.utils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating existing volume attachment record: 1f289c9f-02ea-4f4a-b903-31ccf2327ef0 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:08 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:53:08 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=6748MB free_disk=25.26800537109375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8098e997-fdb1-43ee-bb8a-bed248e3461e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e932a3e8-97ac-4775-aa60-c09f9d6d079f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e647b330-de37-43ae-a64c-d3fbd03492f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:53:08 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:53:09 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:53:09 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:53:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:53:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAbRvSEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:14 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:14 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:14 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[445edf8f-8a7d-4cc0-9882-ea350e819809]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:53:14 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ee4a4-bef7-4ae4-ad38-f74d017ccda5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e] added
Aug 26 17:53:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafcfac8-258c-422b-822a-21539597f61b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.063s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46d8cd-215d-430d-b10c-4e214149646e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAbRvSEs {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAbRvSEs" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[df522db7-a85f-46c7-a8a7-f2f7e4e33e80]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CAbRvSEs'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d9c7cc-5107-45ef-a95c-6b1fe7fe6331]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d8835c-d1b2-4d9b-9c7d-3a1753f79943]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee0f1b-208e-4f92-a351-90ba3d35f869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260]
Aug 26 17:53:15 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260] successful.
Aug 26 17:53:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42b951-a0f8-4aff-9e30-4f98472dd0c0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0006bf-3b02-4df8-91ec-2d792c2f2cab]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:15 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b78a4-4412-4eda-81c3-6af349cce7b5]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAbRvSEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:53:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26435306565626562', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435306565626562', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:53:16 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:16 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:53:16 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:53:16 user nova-compute[73110]:   <serial>7b44814f-5afd-42a7-8ac1-735426085b4e</serial>
Aug 26 17:53:16 user nova-compute[73110]: </disk>
Aug 26 17:53:16 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] No VIF found with MAC fa:16:3e:ff:e1:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ea5e7624-80b4-4cfb-94c3-10476bf73cff tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.691s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:17 user nova-compute[73110]: INFO nova.compute.manager [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Detaching volume 197b0424-7ae3-4b76-ab73-5650ecb35873
Aug 26 17:53:17 user nova-compute[73110]: INFO nova.virt.block_device [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attempting to driver detach volume 197b0424-7ae3-4b76-ab73-5650ecb35873 from mountpoint /dev/vdb
Aug 26 17:53:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Attempting to detach device vdb from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:53:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:53:17 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:17 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:53:17 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:53:17 user nova-compute[73110]:   <serial>197b0424-7ae3-4b76-ab73-5650ecb35873</serial>
Aug 26 17:53:17 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:53:17 user nova-compute[73110]: </disk>
Aug 26 17:53:17 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:53:17 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdb from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the persistent domain config.
Aug 26 17:53:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:53:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:53:17 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:17 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:53:17 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:53:17 user nova-compute[73110]:   <serial>197b0424-7ae3-4b76-ab73-5650ecb35873</serial>
Aug 26 17:53:17 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:53:17 user nova-compute[73110]: </disk>
Aug 26 17:53:17 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072398.1591878, 6a04afc7-0fe6-496a-97cb-9bf275b53da4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:53:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdb from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the live domain config.
Aug 26 17:53:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZjrcQeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:18 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f48a2-d21e-4661-b82f-b794c3ff74a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d598012d-72a4-422b-be1f-7592c49dc677]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 (non-flash)
Aug 26 17:53:18 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441abb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34356d5e-9456-4d5e-bbc6-0914b399c801]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f33732-950a-46ae-bd6c-5efd07c4b277]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e659a4e-3032-49c8-9d2f-a63036a986da]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4953880c-445f-41c3-a871-d8f351de1488]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[291fa20d-8fe6-4ac9-9a5a-837fa716d010]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[78872f06-adec-4010-8020-ae557454d972]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260]
Aug 26 17:53:18 user nova-compute[73110]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873, portal: 172.16.0.220,3260] successful.
Aug 26 17:53:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:197b0424-7ae3-4b76-ab73-5650ecb35873 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ebe1c-0962-4d04-8314-f47d1f572d56]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== disconnect_volume: return (293ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:53:19 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c597c850-6811-4184-bab9-589692b27b43 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:20 user nova-compute[73110]: INFO nova.compute.manager [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Detaching volume 7b44814f-5afd-42a7-8ac1-735426085b4e
Aug 26 17:53:20 user nova-compute[73110]: INFO nova.virt.block_device [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Attempting to driver detach volume 7b44814f-5afd-42a7-8ac1-735426085b4e from mountpoint /dev/vdc
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Attempting to detach device vdc from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:53:20 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:20 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:53:20 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:53:20 user nova-compute[73110]:   <serial>7b44814f-5afd-42a7-8ac1-735426085b4e</serial>
Aug 26 17:53:20 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:53:20 user nova-compute[73110]: </disk>
Aug 26 17:53:20 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:53:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdc from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the persistent domain config.
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:53:20 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:20 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:53:20 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:53:20 user nova-compute[73110]:   <serial>7b44814f-5afd-42a7-8ac1-735426085b4e</serial>
Aug 26 17:53:20 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:53:20 user nova-compute[73110]: </disk>
Aug 26 17:53:20 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072400.6109643, 6a04afc7-0fe6-496a-97cb-9bf275b53da4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:53:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully detached device vdc from instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4 from the live domain config.
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAbRvSEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:20 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[539afd4a-c387-497b-97af-b94fd6359b2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae0558-7524-45a2-bf83-89ca7d3bd768]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:20 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:20 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:20 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:20 user nova-compute[73110]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e (non-flash)
Aug 26 17:53:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54420bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94db2b-bc81-4f62-991e-b971751ec159]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e49f9c-989d-4bea-b13b-fdb01d008850]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f691ae-07b9-4e2a-a6ae-429e9b600dc3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d43838f-4ce0-4476-9bc7-dbab8ca1f2ae]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[10867fce-5616-4cd4-a8fa-c240908aef9b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97574016-1a4f-4c46-82f6-88d50c713bdb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260]
Aug 26 17:53:20 user nova-compute[73110]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e, portal: 172.16.0.220,3260] successful.
Aug 26 17:53:20 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b44814f-5afd-42a7-8ac1-735426085b4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01b77f-1d19-4401-b6e5-dd1dc676dd40]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] <== disconnect_volume: return (267ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:53:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'flavor' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a0d54d71-5fee-4eca-bd32-e14db605d81f tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:22 user nova-compute[73110]: INFO nova.compute.manager [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Terminating instance
Aug 26 17:53:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:53:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-unplugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] No waiting events found dispatching network-vif-unplugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-f32ca133-3c22-4724-a3fa-da5102cbfc90 req-dfc70a76-8e94-44e4-9159-1280ca2df62f service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-unplugged-b98feb61-a4ce-4b66-9591-45b7fe149266 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:53:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Instance destroyed successfully.
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lazy-loading 'resources' on Instance uuid 6a04afc7-0fe6-496a-97cb-9bf275b53da4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-673511871',display_name='tempest-AttachVolumeTestJSON-server-673511871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-673511871',id=25,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5h7dwVcKgjJUjHBLP9T34qoS71R8XSXBblH/D4efgQMCfnRt25g6qlSc2SKdFBc2GYcUTTzOpTDN/RbYskP2BEyGibScG3qUA8MtoMGSGqHWR3Tn5oLJLJ2Y91HKNdrA==',key_name='tempest-keypair-1971226456',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38ce94322c8d42b5a3dbd2af9e84c263',ramdisk_id='',reservation_id='r-a5ick5rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1129991883',owner_user_name='tempest-AttachVolumeTestJSON-1129991883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65b8f68535c94d32b9178427f2654db8',uuid=6a04afc7-0fe6-496a-97cb-9bf275b53da4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converting VIF {"id": "b98feb61-a4ce-4b66-9591-45b7fe149266", "address": "fa:16:3e:ff:e1:4f", "network": {"id": "99446c36-ea67-4c5a-bf6a-74d5ba2c47e5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1658755608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38ce94322c8d42b5a3dbd2af9e84c263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98feb61-a4", "ovs_interfaceid": "b98feb61-a4ce-4b66-9591-45b7fe149266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG os_vif [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb98feb61-a4, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:23 user nova-compute[73110]: INFO os_vif [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=b98feb61-a4ce-4b66-9591-45b7fe149266,network=Network(99446c36-ea67-4c5a-bf6a-74d5ba2c47e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98feb61-a4')
Aug 26 17:53:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Deleting instance files /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4_del
Aug 26 17:53:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Deletion of /opt/stack/data/nova/instances/6a04afc7-0fe6-496a-97cb-9bf275b53da4_del complete
Aug 26 17:53:23 user nova-compute[73110]: INFO nova.compute.manager [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 26 17:53:23 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:53:23 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:53:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:24 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Took 0.89 seconds to deallocate network for instance.
Aug 26 17:53:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:24 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:53:24 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:25 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Deleted allocations for instance 6a04afc7-0fe6-496a-97cb-9bf275b53da4
Aug 26 17:53:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-55382326-4c4e-4447-8dd2-3f7394e93ef9 tempest-AttachVolumeTestJSON-1129991883 tempest-AttachVolumeTestJSON-1129991883-project-member] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] Acquiring lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] Lock "6a04afc7-0fe6-496a-97cb-9bf275b53da4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] No waiting events found dispatching network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:53:25 user nova-compute[73110]: WARNING nova.compute.manager [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received unexpected event network-vif-plugged-b98feb61-a4ce-4b66-9591-45b7fe149266 for instance with vm_state deleted and task_state None.
Aug 26 17:53:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-8804d257-5253-428c-8388-dd507c0b4464 req-b6231690-0d51-4ef3-8125-64de8309aa79 service nova] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Received event network-vif-deleted-b98feb61-a4ce-4b66-9591-45b7fe149266 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-changed-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Refreshing instance network info cache due to event network-changed-162d41c7-3306-486e-8780-d73a62ab91bb. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:53:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] Acquiring lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:53:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] Acquired lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:53:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Refreshing network info cache for port 162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:53:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updated VIF entry in instance network info cache for port 162d41c7-3306-486e-8780-d73a62ab91bb. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:53:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating instance_info_cache with network_info: [{"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1863b73a-f9f1-4ca7-bb87-2c1578fdb1b5 req-839e6e70-9d1c-4c02-8b91-03ef0ce87ead service nova] Releasing lock "refresh_cache-8098e997-fdb1-43ee-bb8a-bed248e3461e" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:31 user nova-compute[73110]: INFO nova.compute.manager [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attaching volume 9cc1f293-2541-44d5-891a-91548055373d to /dev/vdb
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f6d579-b964-4ecf-91c9-ea25f1f71e6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eeaf8c-14d3-4e87-aa39-e42a052bc862]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9df95d-1345-462f-815b-8d57a868d005]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[94afd7c2-5e57-440e-b22c-60b7b7989846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:31 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:53:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffead5b-04cb-4397-8cbd-0b9babd02428]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:31 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating existing volume attachment record: 4bb29ef4-df85-495e-b0d9-411d8d08d8c8 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:53:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:38 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072403.6468205, 6a04afc7-0fe6-496a-97cb-9bf275b53da4 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:53:38 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] VM Stopped (Lifecycle Event)
Aug 26 17:53:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-728fe149-ebac-4206-b579-8d6b6ec19b4a None None] [instance: 6a04afc7-0fe6-496a-97cb-9bf275b53da4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:53:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvZjoqgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:42 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:42 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:42 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9869321-662a-487a-9b76-be4ccbca5dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:53:42 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[445566d3-9db0-470f-a87c-cec66c7ce306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d] added
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a925ae-cb63-46e6-845f-81f0ca707bee]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7fc96f-c7b9-4871-b9a6-01869f9b5277]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvZjoqgD {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvZjoqgD" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66bbc0-d95e-4776-8ca2-ab5a1619119b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SvZjoqgD'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[01796df5-cf0a-4db2-b00b-92f8a024835b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[be384624-08bb-43b2-8099-d5bd166cf932]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f776e799-9034-4879-9d4d-ca45c33bed4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260]
Aug 26 17:53:42 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260] successful.
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c777c-55e7-4c33-8d13-125ed2e7dd29]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[97564309-a7f3-48af-8d92-4cea96cc53bc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:42 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:53:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:53:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea6d404-6247-4c08-9adc-9cbd1711e47f]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:53:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvZjoqgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23266383537346431', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266383537346431', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:53:44 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:53:44 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:53:44 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:53:44 user nova-compute[73110]:   <serial>9cc1f293-2541-44d5-891a-91548055373d</serial>
Aug 26 17:53:44 user nova-compute[73110]: </disk>
Aug 26 17:53:44 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No VIF found with MAC fa:16:3e:6d:82:ce, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:53:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e8e9397f-bd63-4e1e-b455-45b87b201438 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.227s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-changed-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing instance network info cache due to event network-changed-b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG nova.network.neutron [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Refreshing network info cache for port b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:48 user nova-compute[73110]: INFO nova.compute.manager [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attaching volume 8c643ffd-90fe-4d3a-b882-ebf485f710a6 to /dev/vdc
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.utils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1521786f-35d0-48e4-bbcf-8932fcbfe2b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573742d-6ca5-4045-92ed-18915fc61498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[65825339-c5de-4c3d-8652-e86eb94dcc98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3be5b-c896-4a92-83a2-32bc44cac373]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:48 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:53:48 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc579047-8b93-48f5-8345-6a98a37b4fab]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG os_brick.utils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:48 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating existing volume attachment record: eb3b6e15-d361-4811-a60e-017d91124ce9 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:53:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:49 user nova-compute[73110]: DEBUG nova.network.neutron [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated VIF entry in instance network info cache for port b8616500-11c9-4ea0-a472-839831230b20. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:53:49 user nova-compute[73110]: DEBUG nova.network.neutron [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-096f346e-c1bc-4b48-b57d-df7532e2199e req-2f61b4a8-799b-4338-8c43-c7b505a72e12 service nova] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Stashing vm_state: active {{(pid=73110) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-changed-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG nova.compute.manager [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Refreshing instance network info cache due to event network-changed-a6f423aa-51c7-43ad-aa8f-455e4a8e7492. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG nova.network.neutron [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Refreshing network info cache for port a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:53:50 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:53:50 user nova-compute[73110]: INFO nova.compute.claims [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Claim successful on node user
Aug 26 17:53:50 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating resource usage from migration 133caa42-6834-451c-91b3-ca1063b9f9ca
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.506s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:51 user nova-compute[73110]: INFO nova.compute.manager [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Migrating
Aug 26 17:53:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.network.neutron [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updated VIF entry in instance network info cache for port a6f423aa-51c7-43ad-aa8f-455e4a8e7492. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.network.neutron [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-44737406-8028-437c-96d9-2bb5d4718bfb req-b626506a-21a4-4d38-a406-58fbd4c79cfa service nova] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Starting migrate_disk_and_power_off {{(pid=73110) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:53:52 user nova-compute[73110]: WARNING nova.compute.manager [req-5f588df6-0bc4-4551-8512-54442a4d1f7b req-ee91b5aa-4fed-459c-8339-842b3231414c service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state active and task_state resize_migrating.
Aug 26 17:53:52 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance destroyed successfully.
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6f423aa-51, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:52 user nova-compute[73110]: INFO os_vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51')
Aug 26 17:53:52 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:52 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d74601-41aa-4e3f-a85d-bffab78dc44a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3605878-58c5-465a-b79a-72dc2c9912d4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:52 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:52 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:53:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:53:52 user nova-compute[73110]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:53:52 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:53:52 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d313f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb071e8-3498-4a2e-bc05-f9429cc99567]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca7566d-669f-4a21-b471-096e8cbf0c8d]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4584c-7314-423f-b936-479a41481ef6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:53:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[25141f0d-2dd8-48c1-90a5-0d2301286ea5]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_82cb7d73', '/dev/disk/by-id/scsi-23134333061393165', '/dev/disk/by-id/scsi-1SCST_BIO82cb7d73-1430a91eb6fb8310') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29fea6-ed8f-4e96-9ebe-4a555980be9d]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c7737-ca75-4ff1-952e-c9253563ea89]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf3279-df43-4050-a63f-ab2d388ec42b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]
Aug 26 17:53:53 user nova-compute[73110]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.
Aug 26 17:53:53 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc1e470-8ced-4a86-b074-8e62a3e54864]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== disconnect_volume: return (337ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:53:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Port a6f423aa-51c7-43ad-aa8f-455e4a8e7492 binding to destination host user is already ACTIVE {{(pid=73110) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:53:54 user nova-compute[73110]: WARNING nova.compute.manager [req-86fe2903-18d3-4de7-a1ef-39c5eb8aeed1 req-334ab34f-bd80-4b78-af6a-e3a5baf5d3e3 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state active and task_state resize_migrated.
Aug 26 17:53:54 user nova-compute[73110]: DEBUG os_brick.utils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaba532-8b24-436f-91b5-a6fed45d8b87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6d757-01dc-4cd7-b269-3a61750316c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0cb1f4-34f7-4721-baa3-9e83bbb5caa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf941322-64e6-4adc-bb43-8409fd0e3bf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:53:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:53:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:53:55 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:53:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb043b-d2de-4ef5-b4b6-03a65ee5ba97]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:53:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:53:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:53:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:53:55 user nova-compute[73110]: DEBUG os_brick.utils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:53:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:53:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:53:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWUOAeGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:00 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:00 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:00 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520989f-12af-4454-adc7-f594dbb13f3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:54:00 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34719d93-c244-42fc-a520-bed076a8bed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6] added
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba44b10-8075-4e39-ab57-b4e41ade60e6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d04da-e7cb-4257-a82a-e96ed932cff9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWUOAeGI {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWUOAeGI" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a0146b-4089-4ec4-99d5-f06e619485df]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CWUOAeGI'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[42284b8b-17e8-465d-95b6-69677f4906ba]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b3ef1-2b7b-4056-8534-bf585e21cc4c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[12160a7e-219c-467f-9d90-7681c7b0971f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260]
Aug 26 17:54:00 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [{"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ed66e-d7b0-440e-ab17-9a5abb420398]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bcc0b-d03a-40ac-85b1-323eb0fcb387]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:00 user nova-compute[73110]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)
Aug 26 17:54:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-2e75e82b-9455-411f-92e0-e9b831f23a34" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71bc24-8cdf-42f0-a373-c5d72cbdd366]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:54:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWUOAeGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-changed-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Refreshing instance network info cache due to event network-changed-5bf45c54-92e1-4481-91d2-3edcb6c43948. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] Acquiring lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] Acquired lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.network.neutron [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Refreshing network info cache for port 5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23066353462396434', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066353462396434', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:54:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updated VIF entry in instance network info cache for port 5bf45c54-92e1-4481-91d2-3edcb6c43948. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updating instance_info_cache with network_info: [{"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:54:02 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:02 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:54:02 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:54:02 user nova-compute[73110]:   <serial>8c643ffd-90fe-4d3a-b882-ebf485f710a6</serial>
Aug 26 17:54:02 user nova-compute[73110]: </disk>
Aug 26 17:54:02 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-936e3c33-9136-46bd-9cc3-c035d637465e req-f8d5115e-ed5f-4385-a76b-ba3d9f24f92e service nova] Releasing lock "refresh_cache-dd10926b-26ae-4ae3-91f0-26ac2e261c51" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] No VIF found with MAC fa:16:3e:6d:82:ce, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-891446b9-613e-4677-8c50-d170f0b0ad01 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.807s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:03 user nova-compute[73110]: INFO nova.compute.manager [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Detaching volume 8c643ffd-90fe-4d3a-b882-ebf485f710a6
Aug 26 17:54:03 user nova-compute[73110]: INFO nova.virt.block_device [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attempting to driver detach volume 8c643ffd-90fe-4d3a-b882-ebf485f710a6 from mountpoint /dev/vdc
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Attempting to detach device vdc from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:03 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:03 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:54:03 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:54:03 user nova-compute[73110]:   <serial>8c643ffd-90fe-4d3a-b882-ebf485f710a6</serial>
Aug 26 17:54:03 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:54:03 user nova-compute[73110]: </disk>
Aug 26 17:54:03 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully detached device vdc from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the persistent domain config.
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:03 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:03 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 17:54:03 user nova-compute[73110]:   <target dev="vdc" bus="virtio"/>
Aug 26 17:54:03 user nova-compute[73110]:   <serial>8c643ffd-90fe-4d3a-b882-ebf485f710a6</serial>
Aug 26 17:54:03 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 17:54:03 user nova-compute[73110]: </disk>
Aug 26 17:54:03 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-changed-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Refreshing instance network info cache due to event network-changed-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] Acquiring lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] Acquired lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Refreshing network info cache for port 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072443.6810167, 8098e997-fdb1-43ee-bb8a-bed248e3461e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:54:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully detached device vdc from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the live domain config.
Aug 26 17:54:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWUOAeGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:03 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c848c-d7c8-46f0-9355-97c90189bcce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba55e65-6949-4590-b176-3e63f56b8b23]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:03 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:03 user nova-compute[73110]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)
Aug 26 17:54:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:03 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:03 user nova-compute[73110]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 (non-flash)
Aug 26 17:54:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544113f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a455b41-6d06-434b-ad52-c842fb76316e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d3c79-74b3-4e25-8d61-83a0d7db83e8]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[974551bd-0b93-4bdb-9dcc-d192fcaefa9c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4f044-05c5-406d-bbf5-343f85053aab]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8a657-0385-4cb8-aa9b-39582b18cf3f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b050d5c-6b8e-4e66-862f-0141bb65174c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260]
Aug 26 17:54:03 user nova-compute[73110]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c643ffd-90fe-4d3a-b882-ebf485f710a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5be5a-1537-49ad-a7f6-9c57d6a7b90e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== disconnect_volume: return (321ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updated VIF entry in instance network info cache for port 11c3ae4c-cd97-4427-b2a4-ca9030f28e2f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updating instance_info_cache with network_info: [{"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06e0faed-a400-4c7a-8de9-af336adc2670 req-ad671ad1-20e1-4088-af29-6c3cbab3b836 service nova] Releasing lock "refresh_cache-e932a3e8-97ac-4775-aa60-c09f9d6d079f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c6a073b-b7ff-491a-9cb2-edb642b7783c tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG nova.objects.instance [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:06 user nova-compute[73110]: INFO nova.compute.manager [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Attaching volume 1204677c-3355-4762-a967-6df6a5ea3269 to /dev/vdb
Aug 26 17:54:06 user nova-compute[73110]: DEBUG os_brick.utils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[44246ee1-867d-44e7-b613-8059650f51b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1b0494-6591-4946-9c5d-6a299fcdd406]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[125608d8-e5d0-4866-a903-d290d5f9da77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[582bdc03-3d8b-4161-8f5c-e4cd6851f590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:54:07 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b697d1-07f0-4fc8-9ad0-969bcdc1f563]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.utils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updating existing volume attachment record: d6b75a3b-3152-4f61-b25e-a6dbe6276f0e {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Starting finish_migration {{(pid=73110) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:54:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Creating image(s)
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Ensure instance console log exists: /opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start _get_guest_xml network_info=[{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '15062183-9a05-4853-bc0c-23bd6db35ca4', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f2936d04-aa73-49cc-975e-f2f9d1e44f75', 'attached_at': '2023-08-26T17:54:07.000000', 'detached_at': '', 'volume_id': 'f8730888-1a17-4030-beb2-0d1184cc496f', 'serial': 'f8730888-1a17-4030-beb2-0d1184cc496f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:54:07 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:07 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:07 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:07 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:07 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2dfd1d-bdf4-44ba-aa24-373888e27416]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:54:07 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c90594-f41b-4a0c-847c-35d761e2049b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f] added
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ae75a-b5dc-45b7-8657-3a62ec3dbdba]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be2384-c76e-48ed-aef5-34169ee3544d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVenCwEL {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVenCwEL" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa6b79-d58c-4f48-b29b-cab6c94a9592]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVenCwEL'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b69b5bb-e4c0-44fa-8838-556265857066]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[01db7b2e-043d-48e5-920f-471be2ec5cb9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e3cdd-f064-4a7f-916a-5f6e58f010be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]
Aug 26 17:54:07 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17bd0e-3e39-4dc1-9741-39998c08a071]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[100910e8-c43c-4142-8673-794e7a750b3b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:07 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c98ed4-2b56-4e97-95c5-f34086967dc0]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072432.8090887, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:07 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Stopped (Lifecycle Event)
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-126c2594-d039-47e7-99bb-b017f794d0c2 None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-126c2594-d039-47e7-99bb-b017f794d0c2 None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:54:07 user nova-compute[73110]: INFO nova.compute.manager [None req-126c2594-d039-47e7-99bb-b017f794d0c2 None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23134333061393165', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134333061393165', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:54:08 user nova-compute[73110]:   <uuid>f2936d04-aa73-49cc-975e-f2f9d1e44f75</uuid>
Aug 26 17:54:08 user nova-compute[73110]:   <name>instance-0000001b</name>
Aug 26 17:54:08 user nova-compute[73110]:   <memory>2097152</memory>
Aug 26 17:54:08 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:54:08 user nova-compute[73110]:   <metadata>
Aug 26 17:54:08 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:54:08 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:54:08 user nova-compute[73110]:       <nova:name>tempest-ServerActionsTestOtherA-server-1570540143</nova:name>
Aug 26 17:54:08 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:54:07</nova:creationTime>
Aug 26 17:54:08 user nova-compute[73110]:       <nova:flavor name="m1.small">
Aug 26 17:54:08 user nova-compute[73110]:         <nova:memory>2048</nova:memory>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:disk>20</nova:disk>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:54:08 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:54:08 user nova-compute[73110]:       <nova:owner>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:user uuid="c351654543af4a9a86d72d041fcaacb4">tempest-ServerActionsTestOtherA-1020251450-project-member</nova:user>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:project uuid="8688c8465f324c4a9196980792b35718">tempest-ServerActionsTestOtherA-1020251450</nova:project>
Aug 26 17:54:08 user nova-compute[73110]:       </nova:owner>
Aug 26 17:54:08 user nova-compute[73110]:       <nova:ports>
Aug 26 17:54:08 user nova-compute[73110]:         <nova:port uuid="a6f423aa-51c7-43ad-aa8f-455e4a8e7492">
Aug 26 17:54:08 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:54:08 user nova-compute[73110]:         </nova:port>
Aug 26 17:54:08 user nova-compute[73110]:       </nova:ports>
Aug 26 17:54:08 user nova-compute[73110]:     </nova:instance>
Aug 26 17:54:08 user nova-compute[73110]:   </metadata>
Aug 26 17:54:08 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:54:08 user nova-compute[73110]:     <system>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="serial">f2936d04-aa73-49cc-975e-f2f9d1e44f75</entry>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="uuid">f2936d04-aa73-49cc-975e-f2f9d1e44f75</entry>
Aug 26 17:54:08 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:54:08 user nova-compute[73110]:     </system>
Aug 26 17:54:08 user nova-compute[73110]:   </sysinfo>
Aug 26 17:54:08 user nova-compute[73110]:   <os>
Aug 26 17:54:08 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:54:08 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:54:08 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:54:08 user nova-compute[73110]:   </os>
Aug 26 17:54:08 user nova-compute[73110]:   <features>
Aug 26 17:54:08 user nova-compute[73110]:     <acpi/>
Aug 26 17:54:08 user nova-compute[73110]:     <apic/>
Aug 26 17:54:08 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:54:08 user nova-compute[73110]:   </features>
Aug 26 17:54:08 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:54:08 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:54:08 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:54:08 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:54:08 user nova-compute[73110]:   </clock>
Aug 26 17:54:08 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:54:08 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:54:08 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:54:08 user nova-compute[73110]:   </cpu>
Aug 26 17:54:08 user nova-compute[73110]:   <devices>
Aug 26 17:54:08 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:54:08 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:08 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:54:08 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:54:08 user nova-compute[73110]:       <serial>f8730888-1a17-4030-beb2-0d1184cc496f</serial>
Aug 26 17:54:08 user nova-compute[73110]:     </disk>
Aug 26 17:54:08 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:54:08 user nova-compute[73110]:       <mac address="fa:16:3e:a8:17:79"/>
Aug 26 17:54:08 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:54:08 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:54:08 user nova-compute[73110]:       <target dev="tapa6f423aa-51"/>
Aug 26 17:54:08 user nova-compute[73110]:     </interface>
Aug 26 17:54:08 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:54:08 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75/console.log" append="off"/>
Aug 26 17:54:08 user nova-compute[73110]:     </serial>
Aug 26 17:54:08 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:54:08 user nova-compute[73110]:     <video>
Aug 26 17:54:08 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:54:08 user nova-compute[73110]:     </video>
Aug 26 17:54:08 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:54:08 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:54:08 user nova-compute[73110]:     </rng>
Aug 26 17:54:08 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:54:08 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:54:08 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:54:08 user nova-compute[73110]:     </memballoon>
Aug 26 17:54:08 user nova-compute[73110]:   </devices>
Aug 26 17:54:08 user nova-compute[73110]: </domain>
Aug 26 17:54:08 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-129481045-network", "vif_mac": "fa:16:3e:a8:17:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG os_vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6f423aa-51, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6f423aa-51, col_values=(('external_ids', {'iface-id': 'a6f423aa-51c7-43ad-aa8f-455e4a8e7492', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:17:79', 'vm-uuid': 'f2936d04-aa73-49cc-975e-f2f9d1e44f75'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:08 user nova-compute[73110]: INFO os_vif [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51')
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] No VIF found with MAC fa:16:3e:a8:17:79, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7223MB free_disk=25.256622314453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Applying migration context for instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 as it has an incoming, in-progress migration 133caa42-6834-451c-91b3-ca1063b9f9ca. Migration status is post-migrating {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 17:54:09 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating resource usage from migration 133caa42-6834-451c-91b3-ca1063b9f9ca
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f7c61d60-b862-475f-84cd-bf03501890b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8098e997-fdb1-43ee-bb8a-bed248e3461e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e932a3e8-97ac-4775-aa60-c09f9d6d079f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e647b330-de37-43ae-a64c-d3fbd03492f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Migration 133caa42-6834-451c-91b3-ca1063b9f9ca is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lazy-loading 'flavor' on Instance uuid e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:10 user nova-compute[73110]: INFO nova.compute.manager [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Attaching volume 64e1e24b-67d6-47ec-a0ab-e9b46af78b90 to /dev/vdb
Aug 26 17:54:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.utils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0a657-9582-44e1-92fc-faceba2bc8a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1bae7-a846-44f6-9d88-7a6b55dffb5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51dc9b-7859-4a71-9cb8-31d986f206ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[523412e5-ff5f-4881-a5ff-075b545f8852]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:54:10 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fba6c6-6c9b-4e41-880e-a3b93fa606d7]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG os_brick.utils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updating existing volume attachment record: a6708fa8-238c-4f9d-9d2f-65e0b381ecc3 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:10 user nova-compute[73110]: WARNING nova.compute.manager [req-87fc7317-248d-40dd-bda0-751909dc714e req-d7ee4610-3a43-45da-a314-29977b8d19c4 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state active and task_state resize_finish.
Aug 26 17:54:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:11 user nova-compute[73110]: INFO nova.compute.manager [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Rescuing
Aug 26 17:54:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072452.410443, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Resumed (Lifecycle Event)
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance running successfully.
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Failed to set time: agent not configured {{(pid=73110) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7ea96e78-3857-435c-8d1c-4234b88c41ee tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] finish_migration finished successfully. {{(pid=73110) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:12 user nova-compute[73110]: WARNING nova.compute.manager [req-83e5a1e4-67fd-4a04-9ea7-4506cea18d69 req-e87f7b8f-08b8-472f-ae17-609eafaa10db service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state active and task_state resize_finish.
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072452.4174306, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Started (Lifecycle Event)
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance destroyed successfully.
Aug 26 17:54:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Attempting a stable device rescue
Aug 26 17:54:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:54:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Creating image(s)
Aug 26 17:54:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state rescuing.
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fc89697b-5362-411d-b35a-19bf78d79d51 req-ab06f4db-f0dc-4bec-a16d-9129cf5f39c5 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state rescuing.
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.part --force-share --output=json" returned: 0 in 0.270s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.virt.images [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] 3374db29-b0a7-42e5-8326-162cc7f8ec01 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:54:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.part /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.part /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.converted" returned: 0 in 0.630s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.392s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9 --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9,backing_fmt=raw /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9,backing_fmt=raw /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue" returned: 0 in 0.061s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'migration_context' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<524fef5b-abfb-4d7d-b14f-eb899fa526d2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start _get_guest_xml network_info=[{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:49:d4:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3374db29-b0a7-42e5-8326-162cc7f8ec01', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '65ebf20f-dc07-43dc-b7ee-e5c5093167b3', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '524fef5b-abfb-4d7d-b14f-eb899fa526d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a32866a6-0913-4afc-abf4-90953ea46e41', 'serial': 'a32866a6-0913-4afc-abf4-90953ea46e41'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<524fef5b-abfb-4d7d-b14f-eb899fa526d2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'numa_topology' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<524fef5b-abfb-4d7d-b14f-eb899fa526d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.objects.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<524fef5b-abfb-4d7d-b14f-eb899fa526d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:15 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b602c944-d4f5-4abb-88d7-c1757a4a6f85]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KCQplWMP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 17:54:15 user nova-compute[73110]: node.name = iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41
Aug 26 17:54:15 user nova-compute[73110]: node.tpgt = -1
Aug 26 17:54:15 user nova-compute[73110]: node.startup = automatic
Aug 26 17:54:15 user nova-compute[73110]: node.leading_login = No
Aug 26 17:54:15 user nova-compute[73110]: iface.iscsi_ifacename = default
Aug 26 17:54:15 user nova-compute[73110]: iface.net_ifacename = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.ipaddress = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.prefix_len = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.hwaddress = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.transport_name = tcp
Aug 26 17:54:15 user nova-compute[73110]: iface.initiatorname = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.vlan_id = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.vlan_priority = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.vlan_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.iface_num = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.mtu = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.port = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.bootproto = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.subnet_mask = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.gateway = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_alt_client_id = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_dns = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_learn_iqn = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_vendor_id_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_vendor_id = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.dhcp_slp_da = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.fragmentation = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.gratuitous_arp = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.incoming_forwarding = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.tos_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.tos = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.ttl = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.delayed_ack = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.tcp_nagle = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.tcp_wsf_state = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.tcp_wsf = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.tcp_timer_scale = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.tcp_timestamp = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.redirect = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.def_task_mgmt_timeout = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.header_digest = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.data_digest = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.immediate_data = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.initial_r2t = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.data_seq_inorder = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.data_pdu_inorder = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.erl = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.max_receive_data_len = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.first_burst_len = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.max_outstanding_r2t = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.max_burst_len = 0
Aug 26 17:54:15 user nova-compute[73110]: iface.chap_auth = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.bidi_chap = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.strict_login_compliance = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.discovery_auth = <empty>
Aug 26 17:54:15 user nova-compute[73110]: iface.discovery_logout = <empty>
Aug 26 17:54:15 user nova-compute[73110]: node.discovery_address = <empty>
Aug 26 17:54:15 user nova-compute[73110]: node.discovery_port = 0
Aug 26 17:54:15 user nova-compute[73110]: node.discovery_type = static
Aug 26 17:54:15 user nova-compute[73110]: node.session.initial_cmdsn = 0
Aug 26 17:54:15 user nova-compute[73110]: node.session.initial_login_retry_max = 8
Aug 26 17:54:15 user nova-compute[73110]: node.session.xmit_thread_priority = -20
Aug 26 17:54:15 user nova-compute[73110]: node.session.cmds_max = 128
Aug 26 17:54:15 user nova-compute[73110]: node.session.queue_depth = 32
Aug 26 17:54:15 user nova-compute[73110]: node.session.nr_sessions = 1
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.authmethod = CHAP
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.username = KCQplWMP
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.password = ***
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.username_in = <empty>
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.password_in = <empty>
Aug 26 17:54:15 user nova-compute[73110]: node.session.auth.chap_algs = MD5
Aug 26 17:54:15 user nova-compute[73110]: node.session.timeo.replacement_timeout = 120
Aug 26 17:54:15 user nova-compute[73110]: node.session.err_timeo.abort_timeout = 15
Aug 26 17:54:15 user nova-compute[73110]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 17:54:15 user nova-compute[73110]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 17:54:15 user nova-compute[73110]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.FastAbort = Yes
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.InitialR2T = No
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.ImmediateData = Yes
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.MaxConnections = 1
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 17:54:15 user nova-compute[73110]: node.session.iscsi.ERL = 0
Aug 26 17:54:15 user nova-compute[73110]: node.session.scan = manual
Aug 26 17:54:15 user nova-compute[73110]: node.session.reopen_max = 0
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].address = 172.16.0.220
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].port = 3260
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].startup = manual
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].tcp.window_size = 524288
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].tcp.type_of_service = 0
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].timeo.logout_timeout = 15
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].timeo.login_timeout = 15
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].timeo.auth_timeout = 45
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.DataDigest = None
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.IFMarker = No
Aug 26 17:54:15 user nova-compute[73110]: node.conn[0].iscsi.OFMarker = No
Aug 26 17:54:15 user nova-compute[73110]: # END RECORD
Aug 26 17:54:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18247c3-ed07-4867-a316-7697c9703d69]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc61a92-6d12-4e88-ad85-cf1f59067932]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCQplWMP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCQplWMP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e29f5f7-b1cb-4ab9-984c-a4555123010c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCQplWMP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d43f7-9f0e-4e1d-b87a-35a64d19e1fb]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a4a66-676e-4d26-8344-c323b899b52e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:16 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:16 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:16 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:16 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abde1e-fa9a-4535-bc34-0b7ac365a08f]: (4, ('0 0 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23231643363383261', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231643363383261', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488928143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488928143',id=30,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-n0nsdvz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:52:48Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=524fef5b-abfb-4d7d-b14f-eb899fa526d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:49:d4:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:49:d4:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.objects.instance [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.objects.base [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<524fef5b-abfb-4d7d-b14f-eb899fa526d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:54:16 user nova-compute[73110]:   <uuid>524fef5b-abfb-4d7d-b14f-eb899fa526d2</uuid>
Aug 26 17:54:16 user nova-compute[73110]:   <name>instance-0000001e</name>
Aug 26 17:54:16 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:54:16 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:54:16 user nova-compute[73110]:   <metadata>
Aug 26 17:54:16 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:54:16 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1488928143</nova:name>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:54:15</nova:creationTime>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:54:16 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:54:16 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:owner>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 17:54:16 user nova-compute[73110]:       </nova:owner>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:54:16 user nova-compute[73110]:       <nova:ports>
Aug 26 17:54:16 user nova-compute[73110]:         <nova:port uuid="1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b">
Aug 26 17:54:16 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 17:54:16 user nova-compute[73110]:         </nova:port>
Aug 26 17:54:16 user nova-compute[73110]:       </nova:ports>
Aug 26 17:54:16 user nova-compute[73110]:     </nova:instance>
Aug 26 17:54:16 user nova-compute[73110]:   </metadata>
Aug 26 17:54:16 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:54:16 user nova-compute[73110]:     <system>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="serial">524fef5b-abfb-4d7d-b14f-eb899fa526d2</entry>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="uuid">524fef5b-abfb-4d7d-b14f-eb899fa526d2</entry>
Aug 26 17:54:16 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:54:16 user nova-compute[73110]:     </system>
Aug 26 17:54:16 user nova-compute[73110]:   </sysinfo>
Aug 26 17:54:16 user nova-compute[73110]:   <os>
Aug 26 17:54:16 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:54:16 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:54:16 user nova-compute[73110]:   </os>
Aug 26 17:54:16 user nova-compute[73110]:   <features>
Aug 26 17:54:16 user nova-compute[73110]:     <acpi/>
Aug 26 17:54:16 user nova-compute[73110]:     <apic/>
Aug 26 17:54:16 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:54:16 user nova-compute[73110]:   </features>
Aug 26 17:54:16 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:54:16 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:54:16 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:54:16 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:54:16 user nova-compute[73110]:   </clock>
Aug 26 17:54:16 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:54:16 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:54:16 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:54:16 user nova-compute[73110]:   </cpu>
Aug 26 17:54:16 user nova-compute[73110]:   <devices>
Aug 26 17:54:16 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:54:16 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:16 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 17:54:16 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:54:16 user nova-compute[73110]:       <serial>a32866a6-0913-4afc-abf4-90953ea46e41</serial>
Aug 26 17:54:16 user nova-compute[73110]:     </disk>
Aug 26 17:54:16 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:54:16 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:54:16 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue"/>
Aug 26 17:54:16 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:54:16 user nova-compute[73110]:       <boot order="1"/>
Aug 26 17:54:16 user nova-compute[73110]:     </disk>
Aug 26 17:54:16 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:54:16 user nova-compute[73110]:       <mac address="fa:16:3e:49:d4:01"/>
Aug 26 17:54:16 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:54:16 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:54:16 user nova-compute[73110]:       <target dev="tap1cb298fd-da"/>
Aug 26 17:54:16 user nova-compute[73110]:     </interface>
Aug 26 17:54:16 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:54:16 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/console.log" append="off"/>
Aug 26 17:54:16 user nova-compute[73110]:     </serial>
Aug 26 17:54:16 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:54:16 user nova-compute[73110]:     <video>
Aug 26 17:54:16 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:54:16 user nova-compute[73110]:     </video>
Aug 26 17:54:16 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:54:16 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:54:16 user nova-compute[73110]:     </rng>
Aug 26 17:54:16 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:54:16 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:54:16 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:54:16 user nova-compute[73110]:     </memballoon>
Aug 26 17:54:16 user nova-compute[73110]:   </devices>
Aug 26 17:54:16 user nova-compute[73110]: </domain>
Aug 26 17:54:16 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:54:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance destroyed successfully.
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:49:d4:01, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:17 user nova-compute[73110]: WARNING nova.compute.manager [req-e30ab65e-7109-4b7c-a369-d7b923b7fb08 req-3a36bac1-b1c1-4cfc-b9be-26bf15dcb9c3 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state rescuing.
Aug 26 17:54:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrCefLJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:19 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2485e1-0d97-45e4-b804-3a1f79fee89c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:54:19 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9d3a0-3014-4518-a76e-b65f88c630df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269] added
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0e561-5ca0-4b30-848c-30aec7742490]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[03367de6-6d4c-49b5-91a7-150ba9b31d6e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrCefLJg {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrCefLJg" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603d4e0-4a74-4a48-8f87-48225831ad77]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mrCefLJg'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e03203-2915-4248-8fd7-d8788c29fd37]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd8efd-ed30-46db-bfea-47ddabb49e38]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b237fe5-8842-4897-8249-3eb6d319cc2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260]
Aug 26 17:54:19 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[59623035-634c-4e68-9c6a-aadc69a6924e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2965ff-c4e7-4c4d-a4a3-cf63688cff0c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:19 user nova-compute[73110]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)
Aug 26 17:54:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:19 user nova-compute[73110]: WARNING nova.compute.manager [req-d1068b21-a53a-474d-a0f0-b3306e769726 req-14967078-4b8e-4bc7-8674-92f1b055e834 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state rescuing.
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[512673a3-cee4-4782-97bf-4daf24de297c]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:54:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrCefLJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 524fef5b-abfb-4d7d-b14f-eb899fa526d2 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072460.0362442, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Resumed (Lifecycle Event)
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-497d907e-62cc-45b4-9b18-d863d0b11408 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:54:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072460.0382519, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:20 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Started (Lifecycle Event)
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23863633136363430', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863633136363430', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:54:20 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:20 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:20 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:20 user nova-compute[73110]:   <serial>1204677c-3355-4762-a967-6df6a5ea3269</serial>
Aug 26 17:54:20 user nova-compute[73110]: </disk>
Aug 26 17:54:20 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:54:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:59:db:da, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:54:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68436fc1-218c-4a5a-91d5-102995a30016 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.795s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:22 user nova-compute[73110]: INFO nova.compute.manager [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Detaching volume 1204677c-3355-4762-a967-6df6a5ea3269
Aug 26 17:54:22 user nova-compute[73110]: INFO nova.virt.block_device [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Attempting to driver detach volume 1204677c-3355-4762-a967-6df6a5ea3269 from mountpoint /dev/vdb
Aug 26 17:54:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Attempting to detach device vdb from instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:54:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:22 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:22 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:22 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:22 user nova-compute[73110]:   <serial>1204677c-3355-4762-a967-6df6a5ea3269</serial>
Aug 26 17:54:22 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:22 user nova-compute[73110]: </disk>
Aug 26 17:54:22 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 from the persistent domain config.
Aug 26 17:54:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:54:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:22 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:22 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:22 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:22 user nova-compute[73110]:   <serial>1204677c-3355-4762-a967-6df6a5ea3269</serial>
Aug 26 17:54:22 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:22 user nova-compute[73110]: </disk>
Aug 26 17:54:22 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072463.1331735, dd10926b-26ae-4ae3-91f0-26ac2e261c51 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:54:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 from the live domain config.
Aug 26 17:54:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrCefLJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c68cbe-4aaa-4787-8726-92cdfe68da43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba352b0-5afe-45f4-96d7-ccb49dbbe09a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)
Aug 26 17:54:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:23 user nova-compute[73110]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 (non-flash)
Aug 26 17:54:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54461e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71438159-35a0-4734-aa9a-b968eb648078]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1daca2d-f505-4610-9c3d-2a6ac353ecbc]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7b7840-33cb-4d7e-b1ba-2ae12bebcf74]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c5379-ecc4-47e3-ab63-5a40cdda73ff]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917413b-324f-45bd-b05b-c886b30c6296]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[230912d1-265e-4411-8ac0-ff3533636c87]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260]
Aug 26 17:54:23 user nova-compute[73110]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1204677c-3355-4762-a967-6df6a5ea3269 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03da3a2-c1ca-459e-b715-8a99e1cf3a83]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== disconnect_volume: return (345ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:54:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2f930ea6-6224-4350-96aa-80bbe1772927 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.944s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:29 user nova-compute[73110]: INFO nova.compute.manager [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Terminating instance
Aug 26 17:54:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-unplugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] No waiting events found dispatching network-vif-unplugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab865ff9-be70-421b-a2a9-aa9ee31fd96d req-e0994075-a192-4ea6-a73c-d82313599296 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-unplugged-c39bb030-e58f-443b-ab28-53d9f1561f5f for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:54:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Instance destroyed successfully.
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lazy-loading 'resources' on Instance uuid f7c61d60-b862-475f-84cd-bf03501890b0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-836853341',display_name='tempest-SnapshotDataIntegrityTests-server-836853341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-836853341',id=18,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Zj6hWNjV4LNWR9aWmnyOsTy1jhSZE7/LKHFZcs5EWg1ww+rraQLztLsJvQE4hE5Jz07+DfqWGifnP4Jw48BJiQUSPATyiK/ipam8amnmfO4nhfZuuHMWk7zVwuNw4Qw==',key_name='tempest-keypair-956042781',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5a3c5972549491f8b0252e2cf81bf31',ramdisk_id='',reservation_id='r-s141jin4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-592165283',owner_user_name='tempest-SnapshotDataIntegrityTests-592165283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='477c0a3ee08e4e2995e29848c4063204',uuid=f7c61d60-b862-475f-84cd-bf03501890b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converting VIF {"id": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "address": "fa:16:3e:19:82:35", "network": {"id": "303ee0e8-8924-4773-9a76-bc26cddf70e4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1019875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a3c5972549491f8b0252e2cf81bf31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39bb030-e5", "ovs_interfaceid": "c39bb030-e58f-443b-ab28-53d9f1561f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG os_vif [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc39bb030-e5, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:54:30 user nova-compute[73110]: INFO os_vif [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:35,bridge_name='br-int',has_traffic_filtering=True,id=c39bb030-e58f-443b-ab28-53d9f1561f5f,network=Network(303ee0e8-8924-4773-9a76-bc26cddf70e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39bb030-e5')
Aug 26 17:54:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Deleting instance files /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0_del
Aug 26 17:54:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Deletion of /opt/stack/data/nova/instances/f7c61d60-b862-475f-84cd-bf03501890b0_del complete
Aug 26 17:54:31 user nova-compute[73110]: INFO nova.compute.manager [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 17:54:31 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:54:31 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:54:31 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:32 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Took 1.08 seconds to deallocate network for instance.
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-6dc34b74-6f99-4313-8825-aca685adfa48 req-6a3a28f9-a30e-4449-a3a6-adb7ed09ad94 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-deleted-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:32 user nova-compute[73110]: INFO nova.compute.manager [req-6dc34b74-6f99-4313-8825-aca685adfa48 req-6a3a28f9-a30e-4449-a3a6-adb7ed09ad94 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Neutron deleted interface c39bb030-e58f-443b-ab28-53d9f1561f5f; detaching it from the instance and deleting it from the info cache
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.network.neutron [req-6dc34b74-6f99-4313-8825-aca685adfa48 req-6a3a28f9-a30e-4449-a3a6-adb7ed09ad94 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-6dc34b74-6f99-4313-8825-aca685adfa48 req-6a3a28f9-a30e-4449-a3a6-adb7ed09ad94 service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Detach interface failed, port_id=c39bb030-e58f-443b-ab28-53d9f1561f5f, reason: Instance f7c61d60-b862-475f-84cd-bf03501890b0 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] Acquiring lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] Lock "f7c61d60-b862-475f-84cd-bf03501890b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] No waiting events found dispatching network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:32 user nova-compute[73110]: WARNING nova.compute.manager [req-0fbb4646-c26c-4955-bffd-6f1af91a52f7 req-868f899c-8450-46f9-ab62-b5110b960b1c service nova] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Received unexpected event network-vif-plugged-c39bb030-e58f-443b-ab28-53d9f1561f5f for instance with vm_state deleted and task_state None.
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:32 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Deleted allocations for instance f7c61d60-b862-475f-84cd-bf03501890b0
Aug 26 17:54:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1f87a8e4-d0a6-4534-893c-440bf123b095 tempest-SnapshotDataIntegrityTests-592165283 tempest-SnapshotDataIntegrityTests-592165283-project-member] Lock "f7c61d60-b862-475f-84cd-bf03501890b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing instance network info cache due to event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:34 user nova-compute[73110]: DEBUG nova.network.neutron [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:54:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updated VIF entry in instance network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:54:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-08e1784c-f8b8-4004-82df-7abc29f07ede req-1e62740a-1a0c-412d-9e14-85cc378dcf96 service nova] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnGxKkgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:37 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e01a5f-06e1-404e-a3bb-38115734352a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:54:37 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b109f9-7b66-46ee-85be-4560393a23c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90] added
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e5e07f-043b-496d-bb7a-f5ddece3f1aa]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e40946-b921-419d-a961-fd7d883e1831]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FnGxKkgu {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FnGxKkgu" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeab667-dd6c-4d0f-b598-8dea6e584386]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FnGxKkgu'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa06777-2132-4a32-a8dd-54b1c6d6a5c1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[96708007-8ea9-4f0a-98f3-935d7e00f17e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11821b8a-bd29-45a0-8ee0-7cec43558313]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260]
Aug 26 17:54:37 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64eb0d2-5c1a-42d0-9a8d-650152ab9f52]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d0337-bac3-404f-b586-beba47317eef]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:37 user nova-compute[73110]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)
Aug 26 17:54:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d4f825-6d1c-4c47-ae28-33a0c4774cd7]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:54:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnGxKkgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:54:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23932393639393431', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932393639393431', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:54:38 user nova-compute[73110]: DEBUG nova.objects.instance [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lazy-loading 'flavor' on Instance uuid e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:54:38 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:38 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:38 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:38 user nova-compute[73110]:   <serial>64e1e24b-67d6-47ec-a0ab-e9b46af78b90</serial>
Aug 26 17:54:38 user nova-compute[73110]: </disk>
Aug 26 17:54:38 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:54:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:54:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] No VIF found with MAC fa:16:3e:e0:83:3e, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:54:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-491f9eb8-abaa-45db-ba97-b1885a911542 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.504s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:40 user nova-compute[73110]: INFO nova.compute.manager [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Shelving
Aug 26 17:54:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:40 user nova-compute[73110]: WARNING nova.compute.manager [req-548faa65-428a-4959-b04c-0b1b95b9e102 req-88415d45-003c-43fa-a5f8-ad1feb91e7b5 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state active and task_state shelving.
Aug 26 17:54:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance destroyed successfully.
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Beginning cold snapshot process
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.compute.manager [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Detaching volume 64e1e24b-67d6-47ec-a0ab-e9b46af78b90
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.virt.block_device [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Attempting to driver detach volume 64e1e24b-67d6-47ec-a0ab-e9b46af78b90 from mountpoint /dev/vdb
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Attempting to detach device vdb from instance e932a3e8-97ac-4775-aa60-c09f9d6d079f from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:41 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:41 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:41 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:41 user nova-compute[73110]:   <serial>64e1e24b-67d6-47ec-a0ab-e9b46af78b90</serial>
Aug 26 17:54:41 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:41 user nova-compute[73110]: </disk>
Aug 26 17:54:41 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Successfully detached device vdb from instance e932a3e8-97ac-4775-aa60-c09f9d6d079f from the persistent domain config.
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e932a3e8-97ac-4775-aa60-c09f9d6d079f from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:41 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:41 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 17:54:41 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:41 user nova-compute[73110]:   <serial>64e1e24b-67d6-47ec-a0ab-e9b46af78b90</serial>
Aug 26 17:54:41 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:41 user nova-compute[73110]: </disk>
Aug 26 17:54:41 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk /opt/stack/data/nova/instances/snapshots/tmp8ydek_lx/c0ff758e3887462db87c7c677b751209 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072481.8249464, e932a3e8-97ac-4775-aa60-c09f9d6d079f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:54:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Successfully detached device vdb from instance e932a3e8-97ac-4775-aa60-c09f9d6d079f from the live domain config.
Aug 26 17:54:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FnGxKkgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:41 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[af130b79-386b-49d0-bbb5-3e006cff6c06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f9f29-a727-4cd6-ade3-c722aeffb350]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)
Aug 26 17:54:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:41 user nova-compute[73110]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 (non-flash)
Aug 26 17:54:41 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54447b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3721634-a664-4616-b86c-2656f8088c03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a11b5-6298-477f-95dd-58e54ccde986]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e5b73-661c-43ee-90f7-895126fc3311]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:54:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee0f566-d532-4555-ac32-e36047882e26]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk /opt/stack/data/nova/instances/snapshots/tmp8ydek_lx/c0ff758e3887462db87c7c677b751209" returned: 0 in 0.660s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Snapshot extracted, beginning image upload
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[480991c7-186a-48b5-86ac-9ec8fd4e3798]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[462e93a7-e43f-4874-b11f-374ff474b87a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260]
Aug 26 17:54:42 user nova-compute[73110]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:42 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e1e24b-67d6-47ec-a0ab-e9b46af78b90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00045a5-2285-4220-a33c-e8e83cdb538e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] <== disconnect_volume: return (299ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:54:42 user nova-compute[73110]: WARNING nova.compute.manager [req-2435b625-8c54-47b6-9599-5d90e1d9f65c req-4423f006-1a38-4fd5-a905-97e223985db1 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 17:54:42 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lazy-loading 'flavor' on Instance uuid e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed1dd9a3-ab03-45d3-8e05-a23d0a02e89d tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Snapshot image upload complete
Aug 26 17:54:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:44 user nova-compute[73110]: INFO nova.compute.manager [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Shelve offloading
Aug 26 17:54:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance destroyed successfully.
Aug 26 17:54:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance destroyed successfully.
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'resources' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6HGkYJrZgR9RAsJrKbrPa3xXlMGCteSSqFBQEtn32qM+oUFM+geKyJ8jATuAQcl0KqcxyWT8cUf0xA0a1HCUMLXcG21IEboc7r3Zdj0kSYg2pdOqNUcWYI3lmly4UjZQ==',key_name='tempest-keypair-2135638762',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:54:44.377527',shelved_host='user',shelved_image_id='65dbabd7-469e-46b2-af39-408bc06b4d4f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:54:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG os_vif [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2fab18a-23, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:54:45 user nova-compute[73110]: INFO os_vif [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23')
Aug 26 17:54:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Deleting instance files /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9_del
Aug 26 17:54:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Deletion of /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9_del complete
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing instance network info cache due to event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:54:45 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Deleted allocations for instance e647b330-de37-43ae-a64c-d3fbd03492f9
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072470.935349, f7c61d60-b862-475f-84cd-bf03501890b0 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:45 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] VM Stopped (Lifecycle Event)
Aug 26 17:54:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'numa_topology' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0ccc4fe9-d417-431c-91de-7894ac65f5b5 None None] [instance: f7c61d60-b862-475f-84cd-bf03501890b0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:45 user nova-compute[73110]: DEBUG nova.objects.base [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e647b330-de37-43ae-a64c-d3fbd03492f9> lazy-loaded attributes: resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updated VIF entry in instance network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd2fab18a-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6172d1-a7ab-4ff5-b890-8f06e1458cab req-08311c66-7eec-43d5-85b2-aed5ef9efc28 service nova] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:54:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2babbb95-a7f3-4022-ad81-96bbfa6af6ef tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.085s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:54:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:54:53 user nova-compute[73110]: INFO nova.compute.manager [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Detaching volume 9cc1f293-2541-44d5-891a-91548055373d
Aug 26 17:54:53 user nova-compute[73110]: INFO nova.virt.block_device [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Attempting to driver detach volume 9cc1f293-2541-44d5-891a-91548055373d from mountpoint /dev/vdb
Aug 26 17:54:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Attempting to detach device vdb from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:54:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:53 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:53 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:54:53 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:53 user nova-compute[73110]:   <serial>9cc1f293-2541-44d5-891a-91548055373d</serial>
Aug 26 17:54:53 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:53 user nova-compute[73110]: </disk>
Aug 26 17:54:53 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully detached device vdb from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the persistent domain config.
Aug 26 17:54:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:54:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:54:53 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:54:53 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:54:53 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:54:53 user nova-compute[73110]:   <serial>9cc1f293-2541-44d5-891a-91548055373d</serial>
Aug 26 17:54:53 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:54:53 user nova-compute[73110]: </disk>
Aug 26 17:54:53 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072494.1113126, 8098e997-fdb1-43ee-bb8a-bed248e3461e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:54:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully detached device vdb from instance 8098e997-fdb1-43ee-bb8a-bed248e3461e from the live domain config.
Aug 26 17:54:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvZjoqgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:54:54 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a8af7-5b06-4e1f-921f-423a1b0192e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4cd15d-18af-44a4-9c86-1d09619075ce]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:54 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:54 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:54:54 user nova-compute[73110]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d (non-flash)
Aug 26 17:54:54 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:54:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54457dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e1773d-fb4e-463f-be33-e95f7fc7b130]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b6a15-357e-4dd9-b5f2-d5d6acd8dfc4]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6438819c-eb34-440e-9e57-38d9d1321f46]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5b251-c968-476d-b5bf-cc157c09b0cc]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[76713830-fa3f-4691-9bd6-79ad342e99e0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[83786e15-0249-448a-a6c1-72003fc6687a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260]
Aug 26 17:54:54 user nova-compute[73110]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d, portal: 172.16.0.220,3260] successful.
Aug 26 17:54:54 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc1f293-2541-44d5-891a-91548055373d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f397add2-d9eb-48a1-b9b3-f68ef9e2e1df]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] <== disconnect_volume: return (271ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:54:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:55 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'flavor' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:54:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8e6e8bcb-b5f4-47c4-b037-98e8bb9be817 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:54:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:54:56 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072481.13715, e647b330-de37-43ae-a64c-d3fbd03492f9 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:54:56 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Stopped (Lifecycle Event)
Aug 26 17:54:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5886bdf8-ee8b-42ae-8202-9975eb2db944 None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:54:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:54:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updating instance_info_cache with network_info: [{"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-e575d87f-237e-4159-82e8-fe46f6b9d680" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:55:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:55:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:55:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:55:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=25.155216217041016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Applying migration context for instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 as it has an incoming, in-progress migration 133caa42-6834-451c-91b3-ca1063b9f9ca. Migration status is finished {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 17:55:09 user nova-compute[73110]: INFO nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating resource usage from migration 133caa42-6834-451c-91b3-ca1063b9f9ca
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 8098e997-fdb1-43ee-bb8a-bed248e3461e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dd10926b-26ae-4ae3-91f0-26ac2e261c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e932a3e8-97ac-4775-aa60-c09f9d6d079f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Migration 133caa42-6834-451c-91b3-ca1063b9f9ca is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:55:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:55:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:55:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:55:10 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:55:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:11 user nova-compute[73110]: INFO nova.compute.manager [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Rescuing
Aug 26 17:55:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:55:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:55:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:12 user nova-compute[73110]: WARNING nova.compute.manager [req-45c9450a-72fd-422f-a041-6ac982222640 req-8e5de8b5-6598-4923-a60c-3672ee637a54 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:12 user nova-compute[73110]: INFO nova.compute.manager [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Terminating instance
Aug 26 17:55:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance destroyed successfully.
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Attempting rescue
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Creating image(s)
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Instance destroyed successfully.
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'resources' on Instance uuid dd10926b-26ae-4ae3-91f0-26ac2e261c51 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-57748258',display_name='tempest-AttachVolumeNegativeTest-server-57748258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-57748258',id=28,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhAKexQiJik1qh/Mcx3HKKQJOnqN9zavhM8q48zmI2ZPQT2F7FlQP6X59LXeRUJBn/HYkJPy1lIwnqJOm3YIvWXCsUzo0nOxZ6VHNMIAWgMcDISGS8krvKEscSlrfA3+Q==',key_name='tempest-keypair-1924754888',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-v5i4gil3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=dd10926b-26ae-4ae3-91f0-26ac2e261c51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "address": "fa:16:3e:59:db:da", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf45c54-92", "ovs_interfaceid": "5bf45c54-92e1-4481-91d2-3edcb6c43948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG os_vif [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bf45c54-92, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: INFO os_vif [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:db:da,bridge_name='br-int',has_traffic_filtering=True,id=5bf45c54-92e1-4481-91d2-3edcb6c43948,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf45c54-92')
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Deleting instance files /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51_del
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Deletion of /opt/stack/data/nova/instances/dd10926b-26ae-4ae3-91f0-26ac2e261c51_del complete
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:13 user nova-compute[73110]: INFO nova.compute.manager [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 17:55:13 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:55:13 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.220s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue" returned: 0 in 0.060s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'migration_context' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<d7c5e50e-1035-438b-82c0-946cb4c36547> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start _get_guest_xml network_info=[{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:62:9f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<d7c5e50e-1035-438b-82c0-946cb4c36547> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'numa_topology' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<d7c5e50e-1035-438b-82c0-946cb4c36547> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<d7c5e50e-1035-438b-82c0-946cb4c36547> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-326749718',display_name='tempest-ServerRescueNegativeTestJSON-server-326749718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-326749718',id=23,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-2ni9c1a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:50:34Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=d7c5e50e-1035-438b-82c0-946cb4c36547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:62:9f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:62:9f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.objects.base [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<d7c5e50e-1035-438b-82c0-946cb4c36547> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:55:14 user nova-compute[73110]:   <uuid>d7c5e50e-1035-438b-82c0-946cb4c36547</uuid>
Aug 26 17:55:14 user nova-compute[73110]:   <name>instance-00000017</name>
Aug 26 17:55:14 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:55:14 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:55:14 user nova-compute[73110]:   <metadata>
Aug 26 17:55:14 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:55:14 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-326749718</nova:name>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:55:14</nova:creationTime>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:55:14 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:55:14 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:owner>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 17:55:14 user nova-compute[73110]:       </nova:owner>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:55:14 user nova-compute[73110]:       <nova:ports>
Aug 26 17:55:14 user nova-compute[73110]:         <nova:port uuid="4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d">
Aug 26 17:55:14 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:55:14 user nova-compute[73110]:         </nova:port>
Aug 26 17:55:14 user nova-compute[73110]:       </nova:ports>
Aug 26 17:55:14 user nova-compute[73110]:     </nova:instance>
Aug 26 17:55:14 user nova-compute[73110]:   </metadata>
Aug 26 17:55:14 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:55:14 user nova-compute[73110]:     <system>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="serial">d7c5e50e-1035-438b-82c0-946cb4c36547</entry>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="uuid">d7c5e50e-1035-438b-82c0-946cb4c36547</entry>
Aug 26 17:55:14 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:55:14 user nova-compute[73110]:     </system>
Aug 26 17:55:14 user nova-compute[73110]:   </sysinfo>
Aug 26 17:55:14 user nova-compute[73110]:   <os>
Aug 26 17:55:14 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:55:14 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:55:14 user nova-compute[73110]:   </os>
Aug 26 17:55:14 user nova-compute[73110]:   <features>
Aug 26 17:55:14 user nova-compute[73110]:     <acpi/>
Aug 26 17:55:14 user nova-compute[73110]:     <apic/>
Aug 26 17:55:14 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:55:14 user nova-compute[73110]:   </features>
Aug 26 17:55:14 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:55:14 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:55:14 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:55:14 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:55:14 user nova-compute[73110]:   </clock>
Aug 26 17:55:14 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:55:14 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:55:14 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:55:14 user nova-compute[73110]:   </cpu>
Aug 26 17:55:14 user nova-compute[73110]:   <devices>
Aug 26 17:55:14 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:55:14 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:55:14 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue"/>
Aug 26 17:55:14 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:55:14 user nova-compute[73110]:     </disk>
Aug 26 17:55:14 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:55:14 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:55:14 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk"/>
Aug 26 17:55:14 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 17:55:14 user nova-compute[73110]:     </disk>
Aug 26 17:55:14 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:55:14 user nova-compute[73110]:       <mac address="fa:16:3e:62:9f:6c"/>
Aug 26 17:55:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:55:14 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:55:14 user nova-compute[73110]:       <target dev="tap4c4dfc55-0f"/>
Aug 26 17:55:14 user nova-compute[73110]:     </interface>
Aug 26 17:55:14 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:55:14 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/console.log" append="off"/>
Aug 26 17:55:14 user nova-compute[73110]:     </serial>
Aug 26 17:55:14 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:55:14 user nova-compute[73110]:     <video>
Aug 26 17:55:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:55:14 user nova-compute[73110]:     </video>
Aug 26 17:55:14 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:55:14 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:55:14 user nova-compute[73110]:     </rng>
Aug 26 17:55:14 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:55:14 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:55:14 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:55:14 user nova-compute[73110]:     </memballoon>
Aug 26 17:55:14 user nova-compute[73110]:   </devices>
Aug 26 17:55:14 user nova-compute[73110]: </domain>
Aug 26 17:55:14 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:55:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance destroyed successfully.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:62:9f:6c, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-unplugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] No waiting events found dispatching network-vif-unplugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-unplugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] No waiting events found dispatching network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received unexpected event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 for instance with vm_state active and task_state deleting.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:14 user nova-compute[73110]: WARNING nova.compute.manager [req-fbf6adee-74d9-455d-97e1-f96562bb8d10 req-9440efdb-dda9-4787-aaeb-24a869668d5c service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:15 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Took 1.88 seconds to deallocate network for instance.
Aug 26 17:55:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:16 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:55:16 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:55:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:16 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Deleted allocations for instance dd10926b-26ae-4ae3-91f0-26ac2e261c51
Aug 26 17:55:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-622f13d1-d07e-486e-9abe-60ed338f1eb0 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.530s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Acquiring lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "dd10926b-26ae-4ae3-91f0-26ac2e261c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] No waiting events found dispatching network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:17 user nova-compute[73110]: WARNING nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received unexpected event network-vif-plugged-5bf45c54-92e1-4481-91d2-3edcb6c43948 for instance with vm_state deleted and task_state None.
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Received event network-vif-deleted-5bf45c54-92e1-4481-91d2-3edcb6c43948 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:17 user nova-compute[73110]: WARNING nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:17 user nova-compute[73110]: WARNING nova.compute.manager [req-58192a9e-5a3c-4625-a2be-dd434a00f43c req-2ecc7475-8be0-44f9-b0af-b47549bf8147 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state active and task_state rescuing.
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for d7c5e50e-1035-438b-82c0-946cb4c36547 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072517.9662278, d7c5e50e-1035-438b-82c0-946cb4c36547 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:55:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Resumed (Lifecycle Event)
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d8efb762-8e1f-487b-ae57-6924dbb0300a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:55:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 17:55:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072517.968246, d7c5e50e-1035-438b-82c0-946cb4c36547 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:55:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Started (Lifecycle Event)
Aug 26 17:55:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:55:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:28 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072513.7360198, dd10926b-26ae-4ae3-91f0-26ac2e261c51 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:55:28 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] VM Stopped (Lifecycle Event)
Aug 26 17:55:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-771dff11-8ff8-40e9-8e94-020f3ea421a8 None None] [instance: dd10926b-26ae-4ae3-91f0-26ac2e261c51] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:55:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Going to confirm migration 2 {{(pid=73110) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquired lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG nova.network.neutron [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:55:40 user nova-compute[73110]: DEBUG nova.objects.instance [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'info_cache' on Instance uuid f2936d04-aa73-49cc-975e-f2f9d1e44f75 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.network.neutron [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [{"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Releasing lock "refresh_cache-f2936d04-aa73-49cc-975e-f2f9d1e44f75" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.objects.instance [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'migration_context' on Instance uuid f2936d04-aa73-49cc-975e-f2f9d1e44f75 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.objects.base [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Object Instance<f2936d04-aa73-49cc-975e-f2f9d1e44f75> lazy-loaded attributes: info_cache,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:41 user nova-compute[73110]: INFO nova.compute.manager [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Terminating instance
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.445s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:41 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Deleted allocation for migration 133caa42-6834-451c-91b3-ca1063b9f9ca
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-943c33ec-6b7a-4cba-9552-eb8f4077c881 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.731s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-unplugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] No waiting events found dispatching network-vif-unplugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:41 user nova-compute[73110]: DEBUG nova.compute.manager [req-a8e58f40-d6e8-4ead-ad9f-65880106ac64 req-5c40aeef-0c6e-4bc6-892d-2ea74ebd179a service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-unplugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:55:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Instance destroyed successfully.
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.objects.instance [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lazy-loading 'resources' on Instance uuid e932a3e8-97ac-4775-aa60-c09f9d6d079f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-436309372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4363093',id=29,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoivKwr2FJtWV5yZUy1o6nhhTuEs4P6lCvOQtAktG/pN4t19Bp+VpYHmV7GLZmm0Aw9AvlCtpUvEr2CNfRzUnabtNvbv2cjeUE166RcTYyzmxUQFR3UveUCdce1woWmOw==',key_name='tempest-keypair-1128981195',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9e63550f0d24295895234e2c6b33b12',ramdisk_id='',reservation_id='r-5nxsojgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13ea1c4380894411a8b9778eb9b6806e',uuid=e932a3e8-97ac-4775-aa60-c09f9d6d079f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converting VIF {"id": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "address": "fa:16:3e:e0:83:3e", "network": {"id": "37692dd4-5fe1-4257-a844-a3567ba1d687", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-21021106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9e63550f0d24295895234e2c6b33b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c3ae4c-cd", "ovs_interfaceid": "11c3ae4c-cd97-4427-b2a4-ca9030f28e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG os_vif [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11c3ae4c-cd, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:42 user nova-compute[73110]: INFO os_vif [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:83:3e,bridge_name='br-int',has_traffic_filtering=True,id=11c3ae4c-cd97-4427-b2a4-ca9030f28e2f,network=Network(37692dd4-5fe1-4257-a844-a3567ba1d687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c3ae4c-cd')
Aug 26 17:55:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Deleting instance files /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f_del
Aug 26 17:55:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Deletion of /opt/stack/data/nova/instances/e932a3e8-97ac-4775-aa60-c09f9d6d079f_del complete
Aug 26 17:55:42 user nova-compute[73110]: INFO nova.compute.manager [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 17:55:42 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:55:42 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:43 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Took 1.06 seconds to deallocate network for instance.
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-0fd698ef-50ee-45f7-9028-4f6be7c0f119 req-3eea7db2-3ce2-4b41-b32e-3be3cbcae9a7 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-deleted-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:43 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Deleted allocations for instance e932a3e8-97ac-4775-aa60-c09f9d6d079f
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:43 user nova-compute[73110]: INFO nova.compute.manager [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Terminating instance
Aug 26 17:55:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-53238834-7144-447f-9821-a6d05483d309 tempest-TestServerVolumeAttachScenarioOldVersion-668987731 tempest-TestServerVolumeAttachScenarioOldVersion-668987731-project-member] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] Acquiring lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] Lock "e932a3e8-97ac-4775-aa60-c09f9d6d079f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] No waiting events found dispatching network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:44 user nova-compute[73110]: WARNING nova.compute.manager [req-2b388d4c-4e8c-427f-ba95-756434351025 req-c8283416-5de3-4c5b-8b63-41c591ecaee1 service nova] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Received unexpected event network-vif-plugged-11c3ae4c-cd97-4427-b2a4-ca9030f28e2f for instance with vm_state deleted and task_state None.
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-unplugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] No waiting events found dispatching network-vif-unplugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-33dfadca-c6ce-4e19-96ad-afb7105dc9a7 req-ec7a610f-6dfd-45a3-8a84-9624a79257e0 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-unplugged-162d41c7-3306-486e-8780-d73a62ab91bb for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Instance destroyed successfully.
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.objects.instance [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lazy-loading 'resources' on Instance uuid 8098e997-fdb1-43ee-bb8a-bed248e3461e {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-173549576',display_name='tempest-TestServerVolumeAttachmentScenario-server-173549576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-173549576',id=26,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNihgUwani/QMOMlPugJBwlSifpEiGkiiCbxsycbgYwnMmHui5cy3PkVZhMDU5oethM53LfYoKm0ceKAyXdBTAERdIRIbCLt0eZkwS+N+K4kCEbK7VkkydpGHNlwg7HD9w==',key_name='tempest-keypair-937206110',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10eea5ee4c32437db9430b6acd32b6f9',ramdisk_id='',reservation_id='r-l01qhooa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1419611542',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1419611542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c0042b00f44f28bfa5ef33f17da542',uuid=8098e997-fdb1-43ee-bb8a-bed248e3461e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converting VIF {"id": "162d41c7-3306-486e-8780-d73a62ab91bb", "address": "fa:16:3e:6d:82:ce", "network": {"id": "3a0078ef-0d96-4e01-9f40-e32836a9fd04", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1452052359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10eea5ee4c32437db9430b6acd32b6f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162d41c7-33", "ovs_interfaceid": "162d41c7-3306-486e-8780-d73a62ab91bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG os_vif [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap162d41c7-33, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:44 user nova-compute[73110]: INFO os_vif [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:82:ce,bridge_name='br-int',has_traffic_filtering=True,id=162d41c7-3306-486e-8780-d73a62ab91bb,network=Network(3a0078ef-0d96-4e01-9f40-e32836a9fd04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162d41c7-33')
Aug 26 17:55:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Deleting instance files /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e_del
Aug 26 17:55:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Deletion of /opt/stack/data/nova/instances/8098e997-fdb1-43ee-bb8a-bed248e3461e_del complete
Aug 26 17:55:44 user nova-compute[73110]: INFO nova.compute.manager [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 17:55:44 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:55:44 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:55:45 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:55:45 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Took 0.92 seconds to deallocate network for instance.
Aug 26 17:55:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-5539ee2b-41f9-4b3b-a9f1-8cc8fc6db980 req-af24d5f5-6149-4cd8-b966-7e54c34b9fd7 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-deleted-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:46 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Deleted allocations for instance 8098e997-fdb1-43ee-bb8a-bed248e3461e
Aug 26 17:55:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-055d30f7-b9a1-473c-b8ad-8dbfbcbfed72 tempest-TestServerVolumeAttachmentScenario-1419611542 tempest-TestServerVolumeAttachmentScenario-1419611542-project-member] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.255s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] Acquiring lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] Lock "8098e997-fdb1-43ee-bb8a-bed248e3461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:55:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] No waiting events found dispatching network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:55:46 user nova-compute[73110]: WARNING nova.compute.manager [req-a7ed5fe6-ada8-435d-af24-387d4419897f req-53bf3a74-2763-4832-a946-3fdff3f7de00 service nova] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Received unexpected event network-vif-plugged-162d41c7-3306-486e-8780-d73a62ab91bb for instance with vm_state deleted and task_state None.
Aug 26 17:55:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 17:55:57 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:57 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072542.3261588, e932a3e8-97ac-4775-aa60-c09f9d6d079f => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:55:57 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] VM Stopped (Lifecycle Event)
Aug 26 17:55:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5014ed96-41a3-41e4-970a-91da42c65700 None None] [instance: e932a3e8-97ac-4775-aa60-c09f9d6d079f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072544.7429378, 8098e997-fdb1-43ee-bb8a-bed248e3461e => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:55:59 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] VM Stopped (Lifecycle Event)
Aug 26 17:55:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b1a20ab8-ee29-43a4-9861-5c56c6838acb None None] [instance: 8098e997-fdb1-43ee-bb8a-bed248e3461e] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:55:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:56:02 user nova-compute[73110]: INFO nova.compute.manager [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Unrescuing
Aug 26 17:56:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:56:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'flavor' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:03 user nova-compute[73110]: WARNING nova.compute.manager [req-4e9355ba-a46d-4c1f-8f5d-2817c3ad68f2 req-97773ecd-169a-402d-bae3-32253eba8a25 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:56:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:04 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance destroyed successfully.
Aug 26 17:56:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:05 user nova-compute[73110]: WARNING nova.compute.manager [req-ba731346-57f9-4ddc-bac7-92bdc65d1353 req-2df3f5fc-1507-442d-9a24-5202f985bb65 service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 524fef5b-abfb-4d7d-b14f-eb899fa526d2 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072567.6303692, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Resumed (Lifecycle Event)
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-af9201a3-0463-4003-90fd-31645d5160f6 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072567.641071, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Started (Lifecycle Event)
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:07 user nova-compute[73110]: WARNING nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state None.
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:07 user nova-compute[73110]: WARNING nova.compute.manager [req-b0d29db4-ce4d-4da4-a3ea-e06fa7e5b9b2 req-3405a383-5129-4612-9837-b2a4cb31dd1c service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state None.
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:07 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:56:07 user nova-compute[73110]: INFO nova.compute.claims [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Claim successful on node user
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:56:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.policy [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b760f93150047f2b46656642fe57efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9df13541045f0b8baace5322a08c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:56:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Creating image(s)
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "/opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk 1073741824" returned: 0 in 0.466s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.649s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=25.233623504638672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Successfully created port: 374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e575d87f-237e-4159-82e8-fe46f6b9d680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7e265dda-d8d5-434b-82ac-d749265194a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:56:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Cannot resize image /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Ensure instance console log exists: /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Successfully updated port: 374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquired lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-changed-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Refreshing instance network info cache due to event network-changed-374f2c56-e65f-4729-9e60-5f87fbe4587d. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] Acquiring lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating instance_info_cache with network_info: [{"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Releasing lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Instance network_info: |[{"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] Acquired lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Refreshing network info cache for port 374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Start _get_guest_xml network_info=[{"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:56:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1883559819',display_name='tempest-AttachVolumeNegativeTest-server-1883559819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1883559819',id=32,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiYRouCrAlW/7YEN1N4EUu+2U5l+OEQd6t09fL3inH95Vxcfh33d25r4xVBKQr3zoomJbS/DTgBzjt6uSk2co9UtQ3xw25ajH/c+2HTr9sMkGbBFUKOHfQ8V6gA1aGjMg==',key_name='tempest-keypair-210591189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-x874ay56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=7e265dda-d8d5-434b-82ac-d749265194a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:56:11 user nova-compute[73110]:   <uuid>7e265dda-d8d5-434b-82ac-d749265194a4</uuid>
Aug 26 17:56:11 user nova-compute[73110]:   <name>instance-00000020</name>
Aug 26 17:56:11 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:56:11 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:56:11 user nova-compute[73110]:   <metadata>
Aug 26 17:56:11 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:56:11 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1883559819</nova:name>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:56:11</nova:creationTime>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:56:11 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:56:11 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:owner>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:user uuid="3b760f93150047f2b46656642fe57efc">tempest-AttachVolumeNegativeTest-650369-project-member</nova:user>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:project uuid="d0d9df13541045f0b8baace5322a08c4">tempest-AttachVolumeNegativeTest-650369</nova:project>
Aug 26 17:56:11 user nova-compute[73110]:       </nova:owner>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:56:11 user nova-compute[73110]:       <nova:ports>
Aug 26 17:56:11 user nova-compute[73110]:         <nova:port uuid="374f2c56-e65f-4729-9e60-5f87fbe4587d">
Aug 26 17:56:11 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 17:56:11 user nova-compute[73110]:         </nova:port>
Aug 26 17:56:11 user nova-compute[73110]:       </nova:ports>
Aug 26 17:56:11 user nova-compute[73110]:     </nova:instance>
Aug 26 17:56:11 user nova-compute[73110]:   </metadata>
Aug 26 17:56:11 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:56:11 user nova-compute[73110]:     <system>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="serial">7e265dda-d8d5-434b-82ac-d749265194a4</entry>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="uuid">7e265dda-d8d5-434b-82ac-d749265194a4</entry>
Aug 26 17:56:11 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:56:11 user nova-compute[73110]:     </system>
Aug 26 17:56:11 user nova-compute[73110]:   </sysinfo>
Aug 26 17:56:11 user nova-compute[73110]:   <os>
Aug 26 17:56:11 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:56:11 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:56:11 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:56:11 user nova-compute[73110]:   </os>
Aug 26 17:56:11 user nova-compute[73110]:   <features>
Aug 26 17:56:11 user nova-compute[73110]:     <acpi/>
Aug 26 17:56:11 user nova-compute[73110]:     <apic/>
Aug 26 17:56:11 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:56:11 user nova-compute[73110]:   </features>
Aug 26 17:56:11 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:56:11 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:56:11 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:56:11 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:56:11 user nova-compute[73110]:   </clock>
Aug 26 17:56:11 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:56:11 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:56:11 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:56:11 user nova-compute[73110]:   </cpu>
Aug 26 17:56:11 user nova-compute[73110]:   <devices>
Aug 26 17:56:11 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:56:11 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:56:11 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk"/>
Aug 26 17:56:11 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:56:11 user nova-compute[73110]:     </disk>
Aug 26 17:56:11 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:56:11 user nova-compute[73110]:       <mac address="fa:16:3e:79:eb:41"/>
Aug 26 17:56:11 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:11 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:56:11 user nova-compute[73110]:       <target dev="tap374f2c56-e6"/>
Aug 26 17:56:11 user nova-compute[73110]:     </interface>
Aug 26 17:56:11 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:56:11 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/console.log" append="off"/>
Aug 26 17:56:11 user nova-compute[73110]:     </serial>
Aug 26 17:56:11 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:56:11 user nova-compute[73110]:     <video>
Aug 26 17:56:11 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:11 user nova-compute[73110]:     </video>
Aug 26 17:56:11 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:56:11 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:56:11 user nova-compute[73110]:     </rng>
Aug 26 17:56:11 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:56:11 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:56:11 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:56:11 user nova-compute[73110]:     </memballoon>
Aug 26 17:56:11 user nova-compute[73110]:   </devices>
Aug 26 17:56:11 user nova-compute[73110]: </domain>
Aug 26 17:56:11 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1883559819',display_name='tempest-AttachVolumeNegativeTest-server-1883559819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1883559819',id=32,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiYRouCrAlW/7YEN1N4EUu+2U5l+OEQd6t09fL3inH95Vxcfh33d25r4xVBKQr3zoomJbS/DTgBzjt6uSk2co9UtQ3xw25ajH/c+2HTr9sMkGbBFUKOHfQ8V6gA1aGjMg==',key_name='tempest-keypair-210591189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-x874ay56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=7e265dda-d8d5-434b-82ac-d749265194a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG os_vif [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap374f2c56-e6, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap374f2c56-e6, col_values=(('external_ids', {'iface-id': '374f2c56-e65f-4729-9e60-5f87fbe4587d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:eb:41', 'vm-uuid': '7e265dda-d8d5-434b-82ac-d749265194a4'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:11 user nova-compute[73110]: INFO os_vif [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6')
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:79:eb:41, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updated VIF entry in instance network info cache for port 374f2c56-e65f-4729-9e60-5f87fbe4587d. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG nova.network.neutron [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating instance_info_cache with network_info: [{"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a4fe00c0-de2a-4c37-8f76-60d9cdf568b6 req-3f733fd4-1de8-42e1-a810-86317bf85763 service nova] Releasing lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] No waiting events found dispatching network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:12 user nova-compute[73110]: WARNING nova.compute.manager [req-d29543b0-6c40-4da8-a3bf-2d7f8bf3681f req-39dd87ca-002e-41fe-8749-3cd95a3a3c23 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received unexpected event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d for instance with vm_state building and task_state spawning.
Aug 26 17:56:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:14 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072574.9753408, 7e265dda-d8d5-434b-82ac-d749265194a4 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:14 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] VM Resumed (Lifecycle Event)
Aug 26 17:56:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:56:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:56:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Instance spawned successfully.
Aug 26 17:56:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:56:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:15 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072574.9769633, 7e265dda-d8d5-434b-82ac-d749265194a4 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:15 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] VM Started (Lifecycle Event)
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] No waiting events found dispatching network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:15 user nova-compute[73110]: WARNING nova.compute.manager [req-b58e6a06-e922-4cc7-aa0e-550f83b368e7 req-2161872d-287d-4687-857a-e1ee7bf914be service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received unexpected event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d for instance with vm_state building and task_state spawning.
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:15 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:15 user nova-compute[73110]: INFO nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 26 17:56:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:15 user nova-compute[73110]: INFO nova.compute.manager [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Took 7.39 seconds to build instance.
Aug 26 17:56:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e3c1b175-02f4-45d8-8540-7ba6c3b7ed15 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.496s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 17:56:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 17:56:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:56:18 user nova-compute[73110]: INFO nova.compute.claims [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Claim successful on node user
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:56:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.policy [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bce64c3526e34647874c804a72e6f9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54648c4d8c294254846097939cb28e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:56:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Creating image(s)
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "/opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "/opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "/opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk 1073741824" returned: 0 in 0.056s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Successfully created port: 3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Cannot resize image /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Ensure instance console log exists: /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Successfully updated port: 3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquired lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-changed-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Refreshing instance network info cache due to event network-changed-3384562a-49bc-4c56-bd16-415254907330. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] Acquiring lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Updating instance_info_cache with network_info: [{"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Releasing lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Instance network_info: |[{"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] Acquired lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Refreshing network info cache for port 3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Start _get_guest_xml network_info=[{"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:56:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2010831720',display_name='tempest-VolumesNegativeTest-instance-2010831720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2010831720',id=33,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54648c4d8c294254846097939cb28e64',ramdisk_id='',reservation_id='r-5q29ldcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-922275143',owner_user_name='tempest-VolumesNegativeTest-922275143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:19Z,user_data=None,user_id='bce64c3526e34647874c804a72e6f9dc',uuid=6399b866-08a9-4201-9192-6839a461ed37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converting VIF {"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lazy-loading 'pci_devices' on Instance uuid 6399b866-08a9-4201-9192-6839a461ed37 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:56:20 user nova-compute[73110]:   <uuid>6399b866-08a9-4201-9192-6839a461ed37</uuid>
Aug 26 17:56:20 user nova-compute[73110]:   <name>instance-00000021</name>
Aug 26 17:56:20 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:56:20 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:56:20 user nova-compute[73110]:   <metadata>
Aug 26 17:56:20 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:56:20 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:name>tempest-VolumesNegativeTest-instance-2010831720</nova:name>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:56:20</nova:creationTime>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:56:20 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:56:20 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:owner>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:user uuid="bce64c3526e34647874c804a72e6f9dc">tempest-VolumesNegativeTest-922275143-project-member</nova:user>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:project uuid="54648c4d8c294254846097939cb28e64">tempest-VolumesNegativeTest-922275143</nova:project>
Aug 26 17:56:20 user nova-compute[73110]:       </nova:owner>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:56:20 user nova-compute[73110]:       <nova:ports>
Aug 26 17:56:20 user nova-compute[73110]:         <nova:port uuid="3384562a-49bc-4c56-bd16-415254907330">
Aug 26 17:56:20 user nova-compute[73110]:           <nova:ip type="fixed" address="192.168.233.213" ipVersion="4"/>
Aug 26 17:56:20 user nova-compute[73110]:         </nova:port>
Aug 26 17:56:20 user nova-compute[73110]:       </nova:ports>
Aug 26 17:56:20 user nova-compute[73110]:     </nova:instance>
Aug 26 17:56:20 user nova-compute[73110]:   </metadata>
Aug 26 17:56:20 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:56:20 user nova-compute[73110]:     <system>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="serial">6399b866-08a9-4201-9192-6839a461ed37</entry>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="uuid">6399b866-08a9-4201-9192-6839a461ed37</entry>
Aug 26 17:56:20 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:56:20 user nova-compute[73110]:     </system>
Aug 26 17:56:20 user nova-compute[73110]:   </sysinfo>
Aug 26 17:56:20 user nova-compute[73110]:   <os>
Aug 26 17:56:20 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:56:20 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:56:20 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:56:20 user nova-compute[73110]:   </os>
Aug 26 17:56:20 user nova-compute[73110]:   <features>
Aug 26 17:56:20 user nova-compute[73110]:     <acpi/>
Aug 26 17:56:20 user nova-compute[73110]:     <apic/>
Aug 26 17:56:20 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:56:20 user nova-compute[73110]:   </features>
Aug 26 17:56:20 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:56:20 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:56:20 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:56:20 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:56:20 user nova-compute[73110]:   </clock>
Aug 26 17:56:20 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:56:20 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:56:20 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:56:20 user nova-compute[73110]:   </cpu>
Aug 26 17:56:20 user nova-compute[73110]:   <devices>
Aug 26 17:56:20 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:56:20 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:56:20 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk"/>
Aug 26 17:56:20 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:56:20 user nova-compute[73110]:     </disk>
Aug 26 17:56:20 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:56:20 user nova-compute[73110]:       <mac address="fa:16:3e:7b:f6:8b"/>
Aug 26 17:56:20 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:20 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:56:20 user nova-compute[73110]:       <target dev="tap3384562a-49"/>
Aug 26 17:56:20 user nova-compute[73110]:     </interface>
Aug 26 17:56:20 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:56:20 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/console.log" append="off"/>
Aug 26 17:56:20 user nova-compute[73110]:     </serial>
Aug 26 17:56:20 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:56:20 user nova-compute[73110]:     <video>
Aug 26 17:56:20 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:20 user nova-compute[73110]:     </video>
Aug 26 17:56:20 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:56:20 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:56:20 user nova-compute[73110]:     </rng>
Aug 26 17:56:20 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:56:20 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:56:20 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:56:20 user nova-compute[73110]:     </memballoon>
Aug 26 17:56:20 user nova-compute[73110]:   </devices>
Aug 26 17:56:20 user nova-compute[73110]: </domain>
Aug 26 17:56:20 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2010831720',display_name='tempest-VolumesNegativeTest-instance-2010831720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2010831720',id=33,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54648c4d8c294254846097939cb28e64',ramdisk_id='',reservation_id='r-5q29ldcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-922275143',owner_user_name='tempest-VolumesNegativeTest-922275143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:19Z,user_data=None,user_id='bce64c3526e34647874c804a72e6f9dc',uuid=6399b866-08a9-4201-9192-6839a461ed37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converting VIF {"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG os_vif [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3384562a-49, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3384562a-49, col_values=(('external_ids', {'iface-id': '3384562a-49bc-4c56-bd16-415254907330', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:f6:8b', 'vm-uuid': '6399b866-08a9-4201-9192-6839a461ed37'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:20 user nova-compute[73110]: INFO os_vif [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49')
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:56:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] No VIF found with MAC fa:16:3e:7b:f6:8b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:56:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Updated VIF entry in instance network info cache for port 3384562a-49bc-4c56-bd16-415254907330. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:56:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Updating instance_info_cache with network_info: [{"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-524d03fa-8e90-445b-b98b-78bfac664774 req-3fb27e09-7e8f-4a71-9e28-4e1c94beb5fd service nova] Releasing lock "refresh_cache-6399b866-08a9-4201-9192-6839a461ed37" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] No waiting events found dispatching network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:22 user nova-compute[73110]: WARNING nova.compute.manager [req-e97e51c6-28e9-4493-91fd-579d67a78171 req-1d30b14a-f39d-48a6-9620-933c240dbd15 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received unexpected event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 for instance with vm_state building and task_state spawning.
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072584.2913027, 6399b866-08a9-4201-9192-6839a461ed37 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] VM Resumed (Lifecycle Event)
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Instance spawned successfully.
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072584.2947176, 6399b866-08a9-4201-9192-6839a461ed37 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] VM Started (Lifecycle Event)
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:24 user nova-compute[73110]: INFO nova.compute.manager [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Took 6.25 seconds to build instance.
Aug 26 17:56:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3d199cf-a9a7-4b7c-8f80-110496012ea5 tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] No waiting events found dispatching network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:24 user nova-compute[73110]: WARNING nova.compute.manager [req-c3ae968f-e81c-4ba3-b44e-1b103a30a567 req-4f626852-05b3-49ab-aed9-7bc4f609a9b8 service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received unexpected event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 for instance with vm_state active and task_state None.
Aug 26 17:56:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:33 user nova-compute[73110]: INFO nova.compute.manager [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Unshelving
Aug 26 17:56:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_requests' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'numa_topology' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:56:33 user nova-compute[73110]: INFO nova.compute.claims [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Claim successful on node user
Aug 26 17:56:33 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:56:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:33 user nova-compute[73110]: INFO nova.network.neutron [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating port d2fab18a-23f0-49bd-b403-3715800f830a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing instance network info cache due to event network-changed-d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] Acquiring lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:56:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:56:35 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Creating image(s)
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'trusted_certs' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] Acquired lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG nova.network.neutron [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Refreshing network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG nova.objects.base [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e647b330-de37-43ae-a64c-d3fbd03492f9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG nova.virt.images [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] 65dbabd7-469e-46b2-af39-408bc06b4d4f was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:56:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.part /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.part /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.converted" returned: 0 in 0.397s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG nova.network.neutron [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updated VIF entry in instance network info cache for port d2fab18a-23f0-49bd-b403-3715800f830a. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG nova.network.neutron [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-03ead599-ace9-4f3a-9a9d-1c249d8882c2 req-51358c5a-8fd1-4716-a171-235b515adece service nova] Releasing lock "refresh_cache-e647b330-de37-43ae-a64c-d3fbd03492f9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.180s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json" returned: 0 in 0.230s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json" returned: 0 in 0.221s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685,backing_fmt=raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685,backing_fmt=raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk 1073741824" returned: 0 in 0.062s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "ef7a2c1e2296c4e2946619b151f38f5b6a789685" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685 --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'migration_context' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG nova.objects.base [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e647b330-de37-43ae-a64c-d3fbd03492f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:56:38 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Rebasing disk image.
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd -F raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:56:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd -F raw /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk" returned: 0 in 2.765s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Ensure instance console log exists: /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start _get_guest_xml network_info=[{"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cf9e8dd0d0ee4ff017e4fbf264e17cae',container_format='bare',created_at=2023-08-26T17:54:40Z,direct_url=<?>,disk_format='qcow2',id=65dbabd7-469e-46b2-af39-408bc06b4d4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1663823385-shelved',owner='8b35bd237a204d0c9f8d3dffbc755653',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T17:54:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:56:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cf9e8dd0d0ee4ff017e4fbf264e17cae',container_format='bare',created_at=2023-08-26T17:54:40Z,direct_url=<?>,disk_format='qcow2',id=65dbabd7-469e-46b2-af39-408bc06b4d4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1663823385-shelved',owner='8b35bd237a204d0c9f8d3dffbc755653',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T17:54:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'vcpu_model' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.objects.base [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e647b330-de37-43ae-a64c-d3fbd03492f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='65dbabd7-469e-46b2-af39-408bc06b4d4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2135638762',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:54:44.377527',shelved_host='user',shelved_image_id='65dbabd7-469e-46b2-af39-408bc06b4d4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'pci_devices' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.objects.base [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Object Instance<e647b330-de37-43ae-a64c-d3fbd03492f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:56:41 user nova-compute[73110]:   <uuid>e647b330-de37-43ae-a64c-d3fbd03492f9</uuid>
Aug 26 17:56:41 user nova-compute[73110]:   <name>instance-0000001f</name>
Aug 26 17:56:41 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:56:41 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:56:41 user nova-compute[73110]:   <metadata>
Aug 26 17:56:41 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:56:41 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1663823385</nova:name>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:56:41</nova:creationTime>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:56:41 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:56:41 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:owner>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:user uuid="a4f2d956017b4782a5db5b60ff5106d1">tempest-AttachVolumeShelveTestJSON-90237160-project-member</nova:user>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:project uuid="8b35bd237a204d0c9f8d3dffbc755653">tempest-AttachVolumeShelveTestJSON-90237160</nova:project>
Aug 26 17:56:41 user nova-compute[73110]:       </nova:owner>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:root type="image" uuid="65dbabd7-469e-46b2-af39-408bc06b4d4f"/>
Aug 26 17:56:41 user nova-compute[73110]:       <nova:ports>
Aug 26 17:56:41 user nova-compute[73110]:         <nova:port uuid="d2fab18a-23f0-49bd-b403-3715800f830a">
Aug 26 17:56:41 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 17:56:41 user nova-compute[73110]:         </nova:port>
Aug 26 17:56:41 user nova-compute[73110]:       </nova:ports>
Aug 26 17:56:41 user nova-compute[73110]:     </nova:instance>
Aug 26 17:56:41 user nova-compute[73110]:   </metadata>
Aug 26 17:56:41 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:56:41 user nova-compute[73110]:     <system>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="serial">e647b330-de37-43ae-a64c-d3fbd03492f9</entry>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="uuid">e647b330-de37-43ae-a64c-d3fbd03492f9</entry>
Aug 26 17:56:41 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:56:41 user nova-compute[73110]:     </system>
Aug 26 17:56:41 user nova-compute[73110]:   </sysinfo>
Aug 26 17:56:41 user nova-compute[73110]:   <os>
Aug 26 17:56:41 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:56:41 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:56:41 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:56:41 user nova-compute[73110]:   </os>
Aug 26 17:56:41 user nova-compute[73110]:   <features>
Aug 26 17:56:41 user nova-compute[73110]:     <acpi/>
Aug 26 17:56:41 user nova-compute[73110]:     <apic/>
Aug 26 17:56:41 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:56:41 user nova-compute[73110]:   </features>
Aug 26 17:56:41 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:56:41 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:56:41 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:56:41 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:56:41 user nova-compute[73110]:   </clock>
Aug 26 17:56:41 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:56:41 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:56:41 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:56:41 user nova-compute[73110]:   </cpu>
Aug 26 17:56:41 user nova-compute[73110]:   <devices>
Aug 26 17:56:41 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:56:41 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:56:41 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk"/>
Aug 26 17:56:41 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:56:41 user nova-compute[73110]:     </disk>
Aug 26 17:56:41 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:56:41 user nova-compute[73110]:       <mac address="fa:16:3e:32:62:6b"/>
Aug 26 17:56:41 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:41 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:56:41 user nova-compute[73110]:       <target dev="tapd2fab18a-23"/>
Aug 26 17:56:41 user nova-compute[73110]:     </interface>
Aug 26 17:56:41 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:56:41 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/console.log" append="off"/>
Aug 26 17:56:41 user nova-compute[73110]:     </serial>
Aug 26 17:56:41 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:56:41 user nova-compute[73110]:     <video>
Aug 26 17:56:41 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:56:41 user nova-compute[73110]:     </video>
Aug 26 17:56:41 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:56:41 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:56:41 user nova-compute[73110]:     </rng>
Aug 26 17:56:41 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:56:41 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:56:41 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:56:41 user nova-compute[73110]:     </memballoon>
Aug 26 17:56:41 user nova-compute[73110]:   </devices>
Aug 26 17:56:41 user nova-compute[73110]: </domain>
Aug 26 17:56:41 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='65dbabd7-469e-46b2-af39-408bc06b4d4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2135638762',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member',shelved_at='2023-08-26T17:54:44.377527',shelved_host='user',shelved_image_id='65dbabd7-469e-46b2-af39-408bc06b4d4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG os_vif [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2fab18a-23, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2fab18a-23, col_values=(('external_ids', {'iface-id': 'd2fab18a-23f0-49bd-b403-3715800f830a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:62:6b', 'vm-uuid': 'e647b330-de37-43ae-a64c-d3fbd03492f9'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:41 user nova-compute[73110]: INFO os_vif [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23')
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:56:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] No VIF found with MAC fa:16:3e:32:62:6b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:56:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:43 user nova-compute[73110]: WARNING nova.compute.manager [req-013df17a-b84b-4a3c-869b-3c7292c53a07 req-2d08ffd0-0c1e-4e3e-8cf4-07c09429f146 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid e575d87f-237e-4159-82e8-fe46f6b9d680 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid f2936d04-aa73-49cc-975e-f2f9d1e44f75 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 6399b866-08a9-4201-9192-6839a461ed37 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "6399b866-08a9-4201-9192-6839a461ed37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "6399b866-08a9-4201-9192-6839a461ed37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:45 user nova-compute[73110]: WARNING nova.compute.manager [req-9cf58f69-99f1-4eff-a301-93bf5889bd6c req-676cf563-52ef-42e9-8da2-f1f218fd2191 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072605.1628761, e647b330-de37-43ae-a64c-d3fbd03492f9 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Resumed (Lifecycle Event)
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance spawned successfully.
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072605.1694403, e647b330-de37-43ae-a64c-d3fbd03492f9 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Started (Lifecycle Event)
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fc45bff8-3d28-4cc7-8d57-b8b8a405bb7d tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.658s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.147s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:45 user nova-compute[73110]: INFO nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:56:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:57 user nova-compute[73110]: INFO nova.compute.manager [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Terminating instance
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-unplugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] No waiting events found dispatching network-vif-unplugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-fe105429-6603-4550-9a53-bb5bcfd425ba req-b870862a-b5c1-493e-8db4-a5c2e9f6bd7a service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-unplugged-d60f1868-9458-47a6-98d5-e044d65d51b4 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:56:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Instance destroyed successfully.
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.objects.instance [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lazy-loading 'resources' on Instance uuid e575d87f-237e-4159-82e8-fe46f6b9d680 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-176123935',display_name='tempest-ServersNegativeTestJSON-server-176123935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-176123935',id=20,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e8e8d866a04e429135ef1baa0059f0',ramdisk_id='',reservation_id='r-i9s9sv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-794179261',owner_user_name='tempest-ServersNegativeTestJSON-794179261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:48:02Z,user_data=None,user_id='8d8f33fb4e7447d4b696e89192fc3a3e',uuid=e575d87f-237e-4159-82e8-fe46f6b9d680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converting VIF {"id": "d60f1868-9458-47a6-98d5-e044d65d51b4", "address": "fa:16:3e:c1:a0:bb", "network": {"id": "ecab9d09-f81b-4dad-95d8-be54b85eda57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1518704581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e8e8d866a04e429135ef1baa0059f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60f1868-94", "ovs_interfaceid": "d60f1868-9458-47a6-98d5-e044d65d51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG os_vif [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd60f1868-94, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:56:57 user nova-compute[73110]: INFO os_vif [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:a0:bb,bridge_name='br-int',has_traffic_filtering=True,id=d60f1868-9458-47a6-98d5-e044d65d51b4,network=Network(ecab9d09-f81b-4dad-95d8-be54b85eda57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60f1868-94')
Aug 26 17:56:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Deleting instance files /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680_del
Aug 26 17:56:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Deletion of /opt/stack/data/nova/instances/e575d87f-237e-4159-82e8-fe46f6b9d680_del complete
Aug 26 17:56:57 user nova-compute[73110]: INFO nova.compute.manager [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 17:56:57 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:56:57 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:59 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Took 1.14 seconds to deallocate network for instance.
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-d3c1ec15-93f9-43da-92c2-85c8779e4220 req-f2abbcc5-e9e4-44cf-aaa7-b9937ebc8484 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-deleted-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:59 user nova-compute[73110]: INFO nova.compute.manager [req-d3c1ec15-93f9-43da-92c2-85c8779e4220 req-f2abbcc5-e9e4-44cf-aaa7-b9937ebc8484 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Neutron deleted interface d60f1868-9458-47a6-98d5-e044d65d51b4; detaching it from the instance and deleting it from the info cache
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-d3c1ec15-93f9-43da-92c2-85c8779e4220 req-f2abbcc5-e9e4-44cf-aaa7-b9937ebc8484 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-d3c1ec15-93f9-43da-92c2-85c8779e4220 req-f2abbcc5-e9e4-44cf-aaa7-b9937ebc8484 service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Detach interface failed, port_id=d60f1868-9458-47a6-98d5-e044d65d51b4, reason: Instance e575d87f-237e-4159-82e8-fe46f6b9d680 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:59 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Deleted allocations for instance e575d87f-237e-4159-82e8-fe46f6b9d680
Aug 26 17:56:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4acd2d14-8219-4c16-98d6-3968ddae8e4e tempest-ServersNegativeTestJSON-794179261 tempest-ServersNegativeTestJSON-794179261-project-member] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] Acquiring lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] Lock "e575d87f-237e-4159-82e8-fe46f6b9d680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:56:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] No waiting events found dispatching network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:56:59 user nova-compute[73110]: WARNING nova.compute.manager [req-a21a1cc9-2c93-4fb2-a025-a81e654c0bac req-4a58cd78-f627-4e26-aa93-9ece635cc25d service nova] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Received unexpected event network-vif-plugged-d60f1868-9458-47a6-98d5-e044d65d51b4 for instance with vm_state deleted and task_state None.
Aug 26 17:57:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:57:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:02 user nova-compute[73110]: INFO nova.compute.manager [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Unrescuing
Aug 26 17:57:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:57:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:57:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'flavor' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:57:04 user nova-compute[73110]: WARNING nova.compute.manager [req-499f123c-342f-41f6-95e1-c40758fe1a3d req-7f7a89b5-7c33-4611-9312-4726d9b43fcf service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:57:04 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance destroyed successfully.
Aug 26 17:57:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:57:06 user nova-compute[73110]: WARNING nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:57:06 user nova-compute[73110]: WARNING nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:57:06 user nova-compute[73110]: WARNING nova.compute.manager [req-a6cfc031-b1a5-4e01-bf03-abfa6a9351fe req-5c9a5932-51fb-4cbc-a55e-24817fc6a9c4 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state rescued and task_state unrescuing.
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for d7c5e50e-1035-438b-82c0-946cb4c36547 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072628.0230677, d7c5e50e-1035-438b-82c0-946cb4c36547 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:57:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Resumed (Lifecycle Event)
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-41d3a777-7740-4812-a96c-7792f3c7f455 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:57:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072628.0274506, d7c5e50e-1035-438b-82c0-946cb4c36547 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:57:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Started (Lifecycle Event)
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:57:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:57:11 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.167789459228516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7e265dda-d8d5-434b-82ac-d749265194a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 6399b866-08a9-4201-9192-6839a461ed37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e647b330-de37-43ae-a64c-d3fbd03492f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:57:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:12 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072617.818723, e575d87f-237e-4159-82e8-fe46f6b9d680 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:57:12 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] VM Stopped (Lifecycle Event)
Aug 26 17:57:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3a98f91d-8131-4cb3-97e6-55bb13a6b8fa None None] [instance: e575d87f-237e-4159-82e8-fe46f6b9d680] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:57:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:31 user nova-compute[73110]: INFO nova.compute.manager [None req-4b33dbce-6ebb-4864-926c-19ec6a1b40b0 tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Get console output
Aug 26 17:57:31 user nova-compute[73110]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 17:57:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:57:55 user nova-compute[73110]: INFO nova.compute.claims [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Claim successful on node user
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:57:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.policy [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '095465fef30b4fd0a144cb5b7c4ffb7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef6ddc676bd48e4886079097e3e0d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:57:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Creating image(s)
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "/opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk 1073741824" returned: 0 in 0.057s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Cannot resize image /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Ensure instance console log exists: /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:57:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Successfully created port: c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Successfully updated port: c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-changed-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Refreshing instance network info cache due to event network-changed-c9d8efc4-a60e-4163-b032-c289faf17cef. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] Acquiring lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updating instance_info_cache with network_info: [{"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Instance network_info: |[{"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] Acquired lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Refreshing network info cache for port c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:57:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Start _get_guest_xml network_info=[{"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:57:58 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:57:58 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494624125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494624125',id=34,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-we0nrrdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:57:56Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=9020d47e-a37b-4695-9ab7-4c0c5563f958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.objects.instance [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid 9020d47e-a37b-4695-9ab7-4c0c5563f958 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:57:58 user nova-compute[73110]:   <uuid>9020d47e-a37b-4695-9ab7-4c0c5563f958</uuid>
Aug 26 17:57:58 user nova-compute[73110]:   <name>instance-00000022</name>
Aug 26 17:57:58 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:57:58 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:57:58 user nova-compute[73110]:   <metadata>
Aug 26 17:57:58 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:57:58 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-494624125</nova:name>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:57:58</nova:creationTime>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:57:58 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:57:58 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:owner>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 17:57:58 user nova-compute[73110]:       </nova:owner>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:57:58 user nova-compute[73110]:       <nova:ports>
Aug 26 17:57:58 user nova-compute[73110]:         <nova:port uuid="c9d8efc4-a60e-4163-b032-c289faf17cef">
Aug 26 17:57:58 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 17:57:58 user nova-compute[73110]:         </nova:port>
Aug 26 17:57:58 user nova-compute[73110]:       </nova:ports>
Aug 26 17:57:58 user nova-compute[73110]:     </nova:instance>
Aug 26 17:57:58 user nova-compute[73110]:   </metadata>
Aug 26 17:57:58 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:57:58 user nova-compute[73110]:     <system>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="serial">9020d47e-a37b-4695-9ab7-4c0c5563f958</entry>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="uuid">9020d47e-a37b-4695-9ab7-4c0c5563f958</entry>
Aug 26 17:57:58 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:57:58 user nova-compute[73110]:     </system>
Aug 26 17:57:58 user nova-compute[73110]:   </sysinfo>
Aug 26 17:57:58 user nova-compute[73110]:   <os>
Aug 26 17:57:58 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:57:58 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:57:58 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:57:58 user nova-compute[73110]:   </os>
Aug 26 17:57:58 user nova-compute[73110]:   <features>
Aug 26 17:57:58 user nova-compute[73110]:     <acpi/>
Aug 26 17:57:58 user nova-compute[73110]:     <apic/>
Aug 26 17:57:58 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:57:58 user nova-compute[73110]:   </features>
Aug 26 17:57:58 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:57:58 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:57:58 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:57:58 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:57:58 user nova-compute[73110]:   </clock>
Aug 26 17:57:58 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:57:58 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:57:58 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:57:58 user nova-compute[73110]:   </cpu>
Aug 26 17:57:58 user nova-compute[73110]:   <devices>
Aug 26 17:57:58 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:57:58 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:57:58 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk"/>
Aug 26 17:57:58 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:57:58 user nova-compute[73110]:     </disk>
Aug 26 17:57:58 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:57:58 user nova-compute[73110]:       <mac address="fa:16:3e:7b:b9:ff"/>
Aug 26 17:57:58 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:57:58 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:57:58 user nova-compute[73110]:       <target dev="tapc9d8efc4-a6"/>
Aug 26 17:57:58 user nova-compute[73110]:     </interface>
Aug 26 17:57:58 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:57:58 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/console.log" append="off"/>
Aug 26 17:57:58 user nova-compute[73110]:     </serial>
Aug 26 17:57:58 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:57:58 user nova-compute[73110]:     <video>
Aug 26 17:57:58 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:57:58 user nova-compute[73110]:     </video>
Aug 26 17:57:58 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:57:58 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:57:58 user nova-compute[73110]:     </rng>
Aug 26 17:57:58 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:57:58 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:57:58 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:57:58 user nova-compute[73110]:     </memballoon>
Aug 26 17:57:58 user nova-compute[73110]:   </devices>
Aug 26 17:57:58 user nova-compute[73110]: </domain>
Aug 26 17:57:58 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494624125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494624125',id=34,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-we0nrrdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:57:56Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=9020d47e-a37b-4695-9ab7-4c0c5563f958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG os_vif [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d8efc4-a6, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d8efc4-a6, col_values=(('external_ids', {'iface-id': 'c9d8efc4-a60e-4163-b032-c289faf17cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b9:ff', 'vm-uuid': '9020d47e-a37b-4695-9ab7-4c0c5563f958'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:58 user nova-compute[73110]: INFO os_vif [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6')
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:7b:b9:ff, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-changed-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Refreshing instance network info cache due to event network-changed-374f2c56-e65f-4729-9e60-5f87fbe4587d. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] Acquiring lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] Acquired lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:57:58 user nova-compute[73110]: DEBUG nova.network.neutron [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Refreshing network info cache for port 374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updated VIF entry in instance network info cache for port c9d8efc4-a60e-4163-b032-c289faf17cef. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updating instance_info_cache with network_info: [{"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cdef0d55-3905-46ef-9442-fb34c6fd3cd3 req-75077ca2-986b-40f5-b76a-0bffc000432f service nova] Releasing lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updated VIF entry in instance network info cache for port 374f2c56-e65f-4729-9e60-5f87fbe4587d. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating instance_info_cache with network_info: [{"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6e810d87-0dcb-41c5-9861-ef8e476a24de req-9defb0bd-379c-4254-9ed0-b51be3407d06 service nova] Releasing lock "refresh_cache-7e265dda-d8d5-434b-82ac-d749265194a4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:57:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] No waiting events found dispatching network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:00 user nova-compute[73110]: WARNING nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received unexpected event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef for instance with vm_state building and task_state spawning.
Aug 26 17:58:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] No waiting events found dispatching network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:00 user nova-compute[73110]: WARNING nova.compute.manager [req-97b5096d-11b5-4f72-b13f-bce72c4d45d0 req-ed5a8da3-ac26-4861-88a9-9ddc80a82413 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received unexpected event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef for instance with vm_state building and task_state spawning.
Aug 26 17:58:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072681.573873, 9020d47e-a37b-4695-9ab7-4c0c5563f958 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] VM Resumed (Lifecycle Event)
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Instance spawned successfully.
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072681.5783954, 9020d47e-a37b-4695-9ab7-4c0c5563f958 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] VM Started (Lifecycle Event)
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 26 17:58:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:58:01 user nova-compute[73110]: INFO nova.compute.manager [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Took 6.49 seconds to build instance.
Aug 26 17:58:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-81c267c1-bc45-4d5b-89d7-cced86b129d2 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.592s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:03 user nova-compute[73110]: INFO nova.compute.manager [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Attaching volume e6dca006-1472-48a9-903c-e89ee794d5e7 to /dev/vdb
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.utils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae617e57-69c1-4bd9-b7d3-73aa71f5c93b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e5509-d8d1-41d6-90d6-714d6f62a442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6f426-1ff6-47e2-b5a3-a16eace894a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d232c9-0245-4720-a3fc-20493947ffe0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:58:04 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ee83ad-ff5c-4936-ac42-8729d72d35da]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG os_brick.utils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating existing volume attachment record: f57ef0f7-614e-40c5-b0f2-fea1f277b28b {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:58:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:58:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:58:05 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:58:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:58:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:58:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:58:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:08 user nova-compute[73110]: INFO nova.compute.manager [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Terminating instance
Aug 26 17:58:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-unplugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] No waiting events found dispatching network-vif-unplugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-c14b78f1-e666-4c36-951d-973a89760c02 req-36d596a8-369e-432b-87c6-839b39f70aee service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-unplugged-3384562a-49bc-4c56-bd16-415254907330 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:58:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Instance destroyed successfully.
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lazy-loading 'resources' on Instance uuid 6399b866-08a9-4201-9192-6839a461ed37 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2010831720',display_name='tempest-VolumesNegativeTest-instance-2010831720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2010831720',id=33,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54648c4d8c294254846097939cb28e64',ramdisk_id='',reservation_id='r-5q29ldcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-922275143',owner_user_name='tempest-VolumesNegativeTest-922275143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:56:24Z,user_data=None,user_id='bce64c3526e34647874c804a72e6f9dc',uuid=6399b866-08a9-4201-9192-6839a461ed37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converting VIF {"id": "3384562a-49bc-4c56-bd16-415254907330", "address": "fa:16:3e:7b:f6:8b", "network": {"id": "fcd6ed79-a05c-4e59-a384-e19eb0395880", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "54b871ad8fc342588aec66c9783106f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3384562a-49", "ovs_interfaceid": "3384562a-49bc-4c56-bd16-415254907330", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG os_vif [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3384562a-49, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:58:09 user nova-compute[73110]: INFO os_vif [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=3384562a-49bc-4c56-bd16-415254907330,network=Network(fcd6ed79-a05c-4e59-a384-e19eb0395880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3384562a-49')
Aug 26 17:58:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Deleting instance files /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37_del
Aug 26 17:58:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Deletion of /opt/stack/data/nova/instances/6399b866-08a9-4201-9192-6839a461ed37_del complete
Aug 26 17:58:09 user nova-compute[73110]: INFO nova.compute.manager [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:58:09 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid '6399b866-08a9-4201-9192-6839a461ed37' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid '6399b866-08a9-4201-9192-6839a461ed37' (instance-00000021)
Aug 26 17:58:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:58:10 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Took 0.59 seconds to deallocate network for instance.
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:10 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Deleted allocations for instance 6399b866-08a9-4201-9192-6839a461ed37
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b7e536bb-a09d-4bf2-ad25-1e6d114c054b tempest-VolumesNegativeTest-922275143 tempest-VolumesNegativeTest-922275143-project-member] Lock "6399b866-08a9-4201-9192-6839a461ed37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] Acquiring lock "6399b866-08a9-4201-9192-6839a461ed37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] Lock "6399b866-08a9-4201-9192-6839a461ed37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] No waiting events found dispatching network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:11 user nova-compute[73110]: WARNING nova.compute.manager [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received unexpected event network-vif-plugged-3384562a-49bc-4c56-bd16-415254907330 for instance with vm_state deleted and task_state None.
Aug 26 17:58:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-e5af472d-31f0-4a91-9fce-4529f82da245 req-404e5b3a-da3a-4fc5-a7d1-a644c3811a3b service nova] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Received event network-vif-deleted-3384562a-49bc-4c56-bd16-415254907330 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:58:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:58:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7676MB free_disk=25.164100646972656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance f2936d04-aa73-49cc-975e-f2f9d1e44f75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7e265dda-d8d5-434b-82ac-d749265194a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e647b330-de37-43ae-a64c-d3fbd03492f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:58:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIwKnleD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:58:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:58:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:58:15 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1b8b6-2315-4a40-92df-6d1fdcb92c1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:58:15 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26562a-4d0b-4fad-95f9-0b5b46dfc229]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7] added
Aug 26 17:58:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78cfa6-ccd4-4b66-9a70-660b0f6c1b0d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09b712-66fa-4e46-9694-42597d06b94b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIwKnleD {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIwKnleD" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50850823-1a3a-4363-82f0-56bda533c791]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIwKnleD'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d048e-2f0b-4e29-a07c-33c89c1bbb8c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e8465-fabb-406c-ba91-262cecf6b217]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:15 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:15 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6980bf9c-9f6d-4081-869e-48e7f8c083d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260]
Aug 26 17:58:15 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260] successful.
Aug 26 17:58:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f7387-f98e-4bf5-b86f-d6d8f3d6fa27]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fd690-0fe6-44da-986f-f07b681e9db9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:16 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:16 user nova-compute[73110]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)
Aug 26 17:58:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:16 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:16 user nova-compute[73110]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)
Aug 26 17:58:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb3b413-fa69-47cd-8953-032ad9f12ebb]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:58:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIwKnleD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26564376537373732', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564376537373732', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:58:17 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:58:17 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:58:17 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:58:17 user nova-compute[73110]:   <serial>e6dca006-1472-48a9-903c-e89ee794d5e7</serial>
Aug 26 17:58:17 user nova-compute[73110]: </disk>
Aug 26 17:58:17 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] No VIF found with MAC fa:16:3e:79:eb:41, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:58:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e5de7c48-12f5-4b7a-822a-418f2142250b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.837s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:18 user nova-compute[73110]: INFO nova.compute.manager [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Detaching volume e6dca006-1472-48a9-903c-e89ee794d5e7
Aug 26 17:58:18 user nova-compute[73110]: INFO nova.virt.block_device [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Attempting to driver detach volume e6dca006-1472-48a9-903c-e89ee794d5e7 from mountpoint /dev/vdb
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Attempting to detach device vdb from instance 7e265dda-d8d5-434b-82ac-d749265194a4 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:58:18 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:58:18 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:58:18 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:58:18 user nova-compute[73110]:   <serial>e6dca006-1472-48a9-903c-e89ee794d5e7</serial>
Aug 26 17:58:18 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:58:18 user nova-compute[73110]: </disk>
Aug 26 17:58:18 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:58:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance 7e265dda-d8d5-434b-82ac-d749265194a4 from the persistent domain config.
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e265dda-d8d5-434b-82ac-d749265194a4 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:58:18 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:58:18 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 17:58:18 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:58:18 user nova-compute[73110]:   <serial>e6dca006-1472-48a9-903c-e89ee794d5e7</serial>
Aug 26 17:58:18 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:58:18 user nova-compute[73110]: </disk>
Aug 26 17:58:18 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693072698.6920648, 7e265dda-d8d5-434b-82ac-d749265194a4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:58:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully detached device vdb from instance 7e265dda-d8d5-434b-82ac-d749265194a4 from the live domain config.
Aug 26 17:58:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIwKnleD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:58:18 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d19fb-f957-4126-9c58-b7ba4cb1cdf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c771ba-966c-4711-80f9-c63d662d4de5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:18 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:18 user nova-compute[73110]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)
Aug 26 17:58:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:18 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:18 user nova-compute[73110]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 (non-flash)
Aug 26 17:58:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d3acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f2a12-4f33-4308-9de4-98f3c12afe11]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdd4122-38b3-40af-8b1f-f876a4180fe0]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a020b64-0d12-4a5d-9ada-0d359c78ec0a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045fb69-df3a-44b8-9ca5-3613f587ea18]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fa9af-92df-4ce4-8851-eb32c3dc3ccf]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[48453e86-a6cd-4073-a0f2-1d1fa62b7976]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260]
Aug 26 17:58:18 user nova-compute[73110]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7, portal: 172.16.0.220,3260] successful.
Aug 26 17:58:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6dca006-1472-48a9-903c-e89ee794d5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdb34a1-65b0-4972-984c-379ab9fbc74c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:58:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] <== disconnect_volume: return (292ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:58:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:58:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:19 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'flavor' on Instance uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1c7ce8ba-2481-4316-8f4d-0ff86b31d42b tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:23 user nova-compute[73110]: INFO nova.compute.manager [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Terminating instance
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-2d4a3794-c7b2-4375-95ba-68a93321a418 req-514829ee-cf48-4a12-a16b-812ed3b1e8f0 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-unplugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:58:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Instance destroyed successfully.
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lazy-loading 'resources' on Instance uuid e647b330-de37-43ae-a64c-d3fbd03492f9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T17:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1663823385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1663823385',id=31,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6HGkYJrZgR9RAsJrKbrPa3xXlMGCteSSqFBQEtn32qM+oUFM+geKyJ8jATuAQcl0KqcxyWT8cUf0xA0a1HCUMLXcG21IEboc7r3Zdj0kSYg2pdOqNUcWYI3lmly4UjZQ==',key_name='tempest-keypair-2135638762',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b35bd237a204d0c9f8d3dffbc755653',ramdisk_id='',reservation_id='r-7l1ti4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-90237160',owner_user_name='tempest-AttachVolumeShelveTestJSON-90237160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4f2d956017b4782a5db5b60ff5106d1',uuid=e647b330-de37-43ae-a64c-d3fbd03492f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converting VIF {"id": "d2fab18a-23f0-49bd-b403-3715800f830a", "address": "fa:16:3e:32:62:6b", "network": {"id": "6c4b1ae1-4aa7-4ac4-854c-c454de70f107", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1246544879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b35bd237a204d0c9f8d3dffbc755653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fab18a-23", "ovs_interfaceid": "d2fab18a-23f0-49bd-b403-3715800f830a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG os_vif [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2fab18a-23, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:58:24 user nova-compute[73110]: INFO os_vif [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=d2fab18a-23f0-49bd-b403-3715800f830a,network=Network(6c4b1ae1-4aa7-4ac4-854c-c454de70f107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fab18a-23')
Aug 26 17:58:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Deleting instance files /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9_del
Aug 26 17:58:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Deletion of /opt/stack/data/nova/instances/e647b330-de37-43ae-a64c-d3fbd03492f9_del complete
Aug 26 17:58:24 user nova-compute[73110]: INFO nova.compute.manager [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 17:58:24 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072689.3500142, 6399b866-08a9-4201-9192-6839a461ed37 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:58:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 6399b866-08a9-4201-9192-6839a461ed37] VM Stopped (Lifecycle Event)
Aug 26 17:58:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2a0be2b7-fc57-49c8-8eff-e7c0da425273 None None] [instance: 6399b866-08a9-4201-9192-6839a461ed37] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:58:25 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Took 1.19 seconds to deallocate network for instance.
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-69734119-c3ed-4158-ab29-cf218b1bf979 req-8dd9d312-1381-41a0-8f27-20e3afdea663 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-deleted-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:25 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Deleted allocations for instance e647b330-de37-43ae-a64c-d3fbd03492f9
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5c50889-b50b-4e3a-8cfe-c1a9cd6f907b tempest-AttachVolumeShelveTestJSON-90237160 tempest-AttachVolumeShelveTestJSON-90237160-project-member] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.419s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] Acquiring lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] Lock "e647b330-de37-43ae-a64c-d3fbd03492f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] No waiting events found dispatching network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:25 user nova-compute[73110]: WARNING nova.compute.manager [req-f0e45db9-6191-4c18-991e-918943e05b6b req-1476f948-84c6-4ca5-a6c0-4546c85d0506 service nova] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Received unexpected event network-vif-plugged-d2fab18a-23f0-49bd-b403-3715800f830a for instance with vm_state deleted and task_state None.
Aug 26 17:58:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:32 user nova-compute[73110]: INFO nova.compute.manager [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Terminating instance
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f67ba42-de3a-4803-91b2-754f5ee5f325 req-400ac099-f8c7-4206-855b-733a4bd65955 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-unplugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Instance destroyed successfully.
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'resources' on Instance uuid f2936d04-aa73-49cc-975e-f2f9d1e44f75 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1570540143',display_name='tempest-ServerActionsTestOtherA-server-1570540143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1570540143',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-tt52b8it',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:55:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=f2936d04-aa73-49cc-975e-f2f9d1e44f75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "address": "fa:16:3e:a8:17:79", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6f423aa-51", "ovs_interfaceid": "a6f423aa-51c7-43ad-aa8f-455e4a8e7492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_vif [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6f423aa-51, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:58:32 user nova-compute[73110]: INFO os_vif [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:17:79,bridge_name='br-int',has_traffic_filtering=True,id=a6f423aa-51c7-43ad-aa8f-455e4a8e7492,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6f423aa-51')
Aug 26 17:58:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVenCwEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:58:32 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e4e1e-40c3-4024-a9ae-3531d9590bf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cade028-65cf-476c-8c82-8a565849d464]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:32 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:32 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:58:32 user nova-compute[73110]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f (non-flash)
Aug 26 17:58:32 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d38dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa2134-0eee-487d-bb45-c3c7b0423719]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf6729-27b9-4a14-8baf-9b0fca07608b]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c90c167-7930-4a43-ae22-02ac948284a3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:58:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68827b9-fb82-4c85-9195-c78349ec81d6]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_82cb7d73', '/dev/disk/by-id/scsi-23134333061393165', '/dev/disk/by-id/scsi-1SCST_BIO82cb7d73-1430a91eb6fb8310') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b190a29-c855-412b-900c-12f896a70f3e]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2104159-cba4-4174-a0a2-c105df69a780]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077214a-0a7b-4d1d-ab00-72658337871f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260]
Aug 26 17:58:33 user nova-compute[73110]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f, portal: 172.16.0.220,3260] successful.
Aug 26 17:58:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8730888-1a17-4030-beb2-0d1184cc496f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c24362-c8ca-45c6-bfe4-59914dddb1c0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] <== disconnect_volume: return (286ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:58:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Deleting instance files /opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75_del
Aug 26 17:58:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Deletion of /opt/stack/data/nova/instances/f2936d04-aa73-49cc-975e-f2f9d1e44f75_del complete
Aug 26 17:58:33 user nova-compute[73110]: INFO nova.compute.manager [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 17:58:33 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:58:33 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:58:34 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Took 1.17 seconds to deallocate network for instance.
Aug 26 17:58:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] Acquiring lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] No waiting events found dispatching network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:58:34 user nova-compute[73110]: WARNING nova.compute.manager [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received unexpected event network-vif-plugged-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 for instance with vm_state active and task_state deleting.
Aug 26 17:58:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-482a774d-e34a-46cd-bc97-183cf42c49b1 req-31393bc2-01ab-4cbf-bedd-5f809553e479 service nova] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Received event network-vif-deleted-a6f423aa-51c7-43ad-aa8f-455e4a8e7492 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:58:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:35 user nova-compute[73110]: INFO nova.compute.manager [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 17:58:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Deleting volume: f8730888-1a17-4030-beb2-0d1184cc496f {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 17:58:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:58:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:58:35 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:58:35 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:58:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:35 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Deleted allocations for instance f2936d04-aa73-49cc-975e-f2f9d1e44f75
Aug 26 17:58:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-20a6676d-70d3-4a3b-a3e2-ecd671ed8c4f tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "f2936d04-aa73-49cc-975e-f2f9d1e44f75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.610s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:58:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:38 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072703.965192, e647b330-de37-43ae-a64c-d3fbd03492f9 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:58:38 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] VM Stopped (Lifecycle Event)
Aug 26 17:58:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5a9d15af-51e7-40a7-9b83-42c1b3f34f32 None None] [instance: e647b330-de37-43ae-a64c-d3fbd03492f9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:47 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072712.7941437, f2936d04-aa73-49cc-975e-f2f9d1e44f75 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:58:47 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] VM Stopped (Lifecycle Event)
Aug 26 17:58:47 user nova-compute[73110]: DEBUG nova.compute.manager [None req-740f323e-64f0-404c-91e9-9e8b1e28fd1a None None] [instance: f2936d04-aa73-49cc-975e-f2f9d1e44f75] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:58:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:58:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:00 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:59:01 user nova-compute[73110]: INFO nova.compute.claims [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Claim successful on node user
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:59:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.policy [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a8aa997bb214e5f9aa5fd0badb394be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5fcf35a12ef444b87aff6fa79bff21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:59:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Creating image(s)
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk 1073741824" returned: 0 in 0.061s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Cannot resize image /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Ensure instance console log exists: /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Successfully created port: 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:59:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Successfully updated port: 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:59:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:59:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:59:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing instance network info cache due to event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance network_info: |[{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start _get_guest_xml network_info=[{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:59:04 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:04 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-19789833',display_name='tempest-ServerRescueNegativeTestJSON-server-19789833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-19789833',id=35,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqTVYxY6AZqGuMrgmAHbd5F1aKTfzf8+/H6j545GJXhO1/wLJ5skKl+NBjGQ/TpfbFdz3L/TZSitHHX72pR8a3BJo676S7GrKbgcgMbZQGL1M3ppvexjD02HbfaxMJiKg==',key_name='tempest-keypair-662086693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-wwzx9dii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=158e68cf-4eba-4b8b-956c-4eeff158119b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:59:04 user nova-compute[73110]:   <uuid>158e68cf-4eba-4b8b-956c-4eeff158119b</uuid>
Aug 26 17:59:04 user nova-compute[73110]:   <name>instance-00000023</name>
Aug 26 17:59:04 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:59:04 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:59:04 user nova-compute[73110]:   <metadata>
Aug 26 17:59:04 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:59:04 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-19789833</nova:name>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:59:04</nova:creationTime>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:59:04 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:59:04 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:owner>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 17:59:04 user nova-compute[73110]:       </nova:owner>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 17:59:04 user nova-compute[73110]:       <nova:ports>
Aug 26 17:59:04 user nova-compute[73110]:         <nova:port uuid="065c6b2d-1fe3-4338-ab38-06c1b57c2a59">
Aug 26 17:59:04 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:59:04 user nova-compute[73110]:         </nova:port>
Aug 26 17:59:04 user nova-compute[73110]:       </nova:ports>
Aug 26 17:59:04 user nova-compute[73110]:     </nova:instance>
Aug 26 17:59:04 user nova-compute[73110]:   </metadata>
Aug 26 17:59:04 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:59:04 user nova-compute[73110]:     <system>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="serial">158e68cf-4eba-4b8b-956c-4eeff158119b</entry>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="uuid">158e68cf-4eba-4b8b-956c-4eeff158119b</entry>
Aug 26 17:59:04 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:59:04 user nova-compute[73110]:     </system>
Aug 26 17:59:04 user nova-compute[73110]:   </sysinfo>
Aug 26 17:59:04 user nova-compute[73110]:   <os>
Aug 26 17:59:04 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:59:04 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:59:04 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:59:04 user nova-compute[73110]:   </os>
Aug 26 17:59:04 user nova-compute[73110]:   <features>
Aug 26 17:59:04 user nova-compute[73110]:     <acpi/>
Aug 26 17:59:04 user nova-compute[73110]:     <apic/>
Aug 26 17:59:04 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:59:04 user nova-compute[73110]:   </features>
Aug 26 17:59:04 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:59:04 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:59:04 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:59:04 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:59:04 user nova-compute[73110]:   </clock>
Aug 26 17:59:04 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:59:04 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:59:04 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:59:04 user nova-compute[73110]:   </cpu>
Aug 26 17:59:04 user nova-compute[73110]:   <devices>
Aug 26 17:59:04 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 17:59:04 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:59:04 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk"/>
Aug 26 17:59:04 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:59:04 user nova-compute[73110]:     </disk>
Aug 26 17:59:04 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:59:04 user nova-compute[73110]:       <mac address="fa:16:3e:59:4a:4f"/>
Aug 26 17:59:04 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:59:04 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:59:04 user nova-compute[73110]:       <target dev="tap065c6b2d-1f"/>
Aug 26 17:59:04 user nova-compute[73110]:     </interface>
Aug 26 17:59:04 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:59:04 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/console.log" append="off"/>
Aug 26 17:59:04 user nova-compute[73110]:     </serial>
Aug 26 17:59:04 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:59:04 user nova-compute[73110]:     <video>
Aug 26 17:59:04 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:59:04 user nova-compute[73110]:     </video>
Aug 26 17:59:04 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:59:04 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:59:04 user nova-compute[73110]:     </rng>
Aug 26 17:59:04 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:59:04 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:59:04 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:59:04 user nova-compute[73110]:     </memballoon>
Aug 26 17:59:04 user nova-compute[73110]:   </devices>
Aug 26 17:59:04 user nova-compute[73110]: </domain>
Aug 26 17:59:04 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-19789833',display_name='tempest-ServerRescueNegativeTestJSON-server-19789833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-19789833',id=35,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqTVYxY6AZqGuMrgmAHbd5F1aKTfzf8+/H6j545GJXhO1/wLJ5skKl+NBjGQ/TpfbFdz3L/TZSitHHX72pR8a3BJo676S7GrKbgcgMbZQGL1M3ppvexjD02HbfaxMJiKg==',key_name='tempest-keypair-662086693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-wwzx9dii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=158e68cf-4eba-4b8b-956c-4eeff158119b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG os_vif [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap065c6b2d-1f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap065c6b2d-1f, col_values=(('external_ids', {'iface-id': '065c6b2d-1fe3-4338-ab38-06c1b57c2a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:4a:4f', 'vm-uuid': '158e68cf-4eba-4b8b-956c-4eeff158119b'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:04 user nova-compute[73110]: INFO os_vif [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f')
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:59:4a:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updated VIF entry in instance network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7b548da6-fd42-422d-a4be-d54e44120dfa req-4110a820-9f12-49c2-99e5-34246f460f4c service nova] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:59:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:06 user nova-compute[73110]: WARNING nova.compute.manager [req-95f9d765-e8eb-47c2-9ade-6eb47f9a039c req-c45995cc-9c12-448c-93a2-7a4fccb86e97 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state building and task_state spawning.
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:59:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072748.1146924, 158e68cf-4eba-4b8b-956c-4eeff158119b => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Resumed (Lifecycle Event)
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance spawned successfully.
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072748.1166823, 158e68cf-4eba-4b8b-956c-4eeff158119b => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Started (Lifecycle Event)
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:08 user nova-compute[73110]: WARNING nova.compute.manager [req-ab98a4a4-7222-418a-aaa9-1990ad399652 req-a9b6e143-7160-4235-b69e-54959be2febb service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state building and task_state spawning.
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Took 7.20 seconds to build instance.
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8979e79f-d00e-4fb6-ad40-cf6a1274917f tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:08 user nova-compute[73110]: INFO nova.compute.manager [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Terminating instance
Aug 26 17:59:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-unplugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] No waiting events found dispatching network-vif-unplugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-1e296a1d-5f39-4e61-a47b-86c55ce7b963 req-b996c408-fb4f-408c-8408-5e181b88cf52 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-unplugged-374f2c56-e65f-4729-9e60-5f87fbe4587d for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Instance destroyed successfully.
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lazy-loading 'resources' on Instance uuid 7e265dda-d8d5-434b-82ac-d749265194a4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1883559819',display_name='tempest-AttachVolumeNegativeTest-server-1883559819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1883559819',id=32,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiYRouCrAlW/7YEN1N4EUu+2U5l+OEQd6t09fL3inH95Vxcfh33d25r4xVBKQr3zoomJbS/DTgBzjt6uSk2co9UtQ3xw25ajH/c+2HTr9sMkGbBFUKOHfQ8V6gA1aGjMg==',key_name='tempest-keypair-210591189',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d9df13541045f0b8baace5322a08c4',ramdisk_id='',reservation_id='r-x874ay56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-650369',owner_user_name='tempest-AttachVolumeNegativeTest-650369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b760f93150047f2b46656642fe57efc',uuid=7e265dda-d8d5-434b-82ac-d749265194a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converting VIF {"id": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "address": "fa:16:3e:79:eb:41", "network": {"id": "440c945a-34f8-40d1-8505-191a2c93e7ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-788408371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d9df13541045f0b8baace5322a08c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f2c56-e6", "ovs_interfaceid": "374f2c56-e65f-4729-9e60-5f87fbe4587d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG os_vif [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap374f2c56-e6, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:09 user nova-compute[73110]: INFO os_vif [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:eb:41,bridge_name='br-int',has_traffic_filtering=True,id=374f2c56-e65f-4729-9e60-5f87fbe4587d,network=Network(440c945a-34f8-40d1-8505-191a2c93e7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f2c56-e6')
Aug 26 17:59:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Deleting instance files /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4_del
Aug 26 17:59:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Deletion of /opt/stack/data/nova/instances/7e265dda-d8d5-434b-82ac-d749265194a4_del complete
Aug 26 17:59:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:09 user nova-compute[73110]: INFO nova.compute.manager [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-e7d63d9d-c632-4cad-a3b5-f70dd769eea7 req-49c48a85-c22f-4fda-bf82-ea879984a2f4 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-deleted-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:10 user nova-compute[73110]: INFO nova.compute.manager [req-e7d63d9d-c632-4cad-a3b5-f70dd769eea7 req-49c48a85-c22f-4fda-bf82-ea879984a2f4 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Neutron deleted interface 374f2c56-e65f-4729-9e60-5f87fbe4587d; detaching it from the instance and deleting it from the info cache
Aug 26 17:59:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-e7d63d9d-c632-4cad-a3b5-f70dd769eea7 req-49c48a85-c22f-4fda-bf82-ea879984a2f4 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:10 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Took 1.04 seconds to deallocate network for instance.
Aug 26 17:59:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-e7d63d9d-c632-4cad-a3b5-f70dd769eea7 req-49c48a85-c22f-4fda-bf82-ea879984a2f4 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Detach interface failed, port_id=374f2c56-e65f-4729-9e60-5f87fbe4587d, reason: Instance 7e265dda-d8d5-434b-82ac-d749265194a4 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] Acquiring lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] Lock "7e265dda-d8d5-434b-82ac-d749265194a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] No waiting events found dispatching network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:11 user nova-compute[73110]: WARNING nova.compute.manager [req-56344796-16c9-4ab6-92cb-f882f5814c52 req-c54ed366-f796-4eb6-a12f-0cc311270227 service nova] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Received unexpected event network-vif-plugged-374f2c56-e65f-4729-9e60-5f87fbe4587d for instance with vm_state deleted and task_state None.
Aug 26 17:59:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:11 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Deleted allocations for instance 7e265dda-d8d5-434b-82ac-d749265194a4
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-de2b913d-f263-46be-8c17-b57e35acbbe9 tempest-AttachVolumeNegativeTest-650369 tempest-AttachVolumeNegativeTest-650369-project-member] Lock "7e265dda-d8d5-434b-82ac-d749265194a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.765s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:12 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid '7e265dda-d8d5-434b-82ac-d749265194a4' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid '7e265dda-d8d5-434b-82ac-d749265194a4' (instance-00000020)
Aug 26 17:59:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.163894653320312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:59:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:59:15 user nova-compute[73110]: INFO nova.compute.claims [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Claim successful on node user
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:59:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:59:15 user nova-compute[73110]: DEBUG nova.policy [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:59:15 user nova-compute[73110]: INFO nova.virt.block_device [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Booting with volume snapshot 47eea703-1333-43fd-b17a-3f97dab12014 at /dev/vda
Aug 26 17:59:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Successfully created port: 554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Successfully updated port: 554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-changed-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Refreshing instance network info cache due to event network-changed-554f831f-e7a9-4f1f-be1b-746176e8811e. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] Acquiring lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:59:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Updating instance_info_cache with network_info: [{"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Instance network_info: |[{"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] Acquired lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Refreshing network info cache for port 554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Updated VIF entry in instance network info cache for port 554f831f-e7a9-4f1f-be1b-746176e8811e. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Updating instance_info_cache with network_info: [{"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ae4368fe-fbe6-4cbc-a4e3-c994224778f5 req-613c58ee-d0b6-4b68-8949-09a0c3ebacc8 service nova] Releasing lock "refresh_cache-863369e8-8359-44e5-8e6f-bbae8ec8f768" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:59:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:59:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:24 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072749.514649, 7e265dda-d8d5-434b-82ac-d749265194a4 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] VM Stopped (Lifecycle Event)
Aug 26 17:59:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1d27bbdd-1ed8-42b5-909a-100738d5f8cb None None] [instance: 7e265dda-d8d5-434b-82ac-d749265194a4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbb2c8e-af88-46bb-9c86-fb3762288623]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d6d1f-47c2-47ba-b100-d3ed49414a6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb2d4f-4269-4108-8d31-1d0d7d8f707d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af8d906-bfd1-4bfb-8420-34c37b08ff1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:59:31 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:59:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d90541-ebec-4198-82b7-957c96f512bd]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG os_brick.utils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:59:31 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Updating existing volume attachment record: 140f7e31-e53c-4410-a531-40f15f86ed8d {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:59:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:36 user nova-compute[73110]: INFO nova.compute.manager [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Terminating instance
Aug 26 17:59:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-unplugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] No waiting events found dispatching network-vif-unplugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-034be700-8dbb-4784-9fd3-25b94546197c req-3628dbd3-7d18-4303-8c7f-163c7d5aae65 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-unplugged-b8616500-11c9-4ea0-a472-839831230b20 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:59:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Instance destroyed successfully.
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lazy-loading 'resources' on Instance uuid 2e75e82b-9455-411f-92e0-e9b831f23a34 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-801884025',display_name='tempest-ServerActionsTestOtherA-server-801884025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-801884025',id=2,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPlRKF8vSomHNQPHm7cXVm+k6Exrvx/jKFx6UuSjIuNWWRGv2cBIMMAN1DSCK8GRNla13NNIWzjtRP3UYJ5OYjqqzspF/nIL1nZxh5FPAHoqDjZ5DKbp6ceVM6RE4iSg==',key_name='tempest-keypair-1914941418',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8688c8465f324c4a9196980792b35718',ramdisk_id='',reservation_id='r-zl3906y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1020251450',owner_user_name='tempest-ServerActionsTestOtherA-1020251450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c351654543af4a9a86d72d041fcaacb4',uuid=2e75e82b-9455-411f-92e0-e9b831f23a34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converting VIF {"id": "b8616500-11c9-4ea0-a472-839831230b20", "address": "fa:16:3e:ef:14:59", "network": {"id": "89295aeb-d1f9-4550-96cb-fee4890ffe10", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-129481045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8688c8465f324c4a9196980792b35718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8616500-11", "ovs_interfaceid": "b8616500-11c9-4ea0-a472-839831230b20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG os_vif [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8616500-11, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:37 user nova-compute[73110]: INFO os_vif [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:14:59,bridge_name='br-int',has_traffic_filtering=True,id=b8616500-11c9-4ea0-a472-839831230b20,network=Network(89295aeb-d1f9-4550-96cb-fee4890ffe10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8616500-11')
Aug 26 17:59:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Deleting instance files /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34_del
Aug 26 17:59:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Deletion of /opt/stack/data/nova/instances/2e75e82b-9455-411f-92e0-e9b831f23a34_del complete
Aug 26 17:59:37 user nova-compute[73110]: INFO nova.compute.manager [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 17:59:37 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:59:37 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:38 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Took 0.59 seconds to deallocate network for instance.
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-d6717ae2-0961-4929-859f-e51da0ae74f7 req-769cba21-7e90-4b4d-bee8-ac69a0f12afb service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-deleted-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:38 user nova-compute[73110]: INFO nova.compute.manager [req-d6717ae2-0961-4929-859f-e51da0ae74f7 req-769cba21-7e90-4b4d-bee8-ac69a0f12afb service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Neutron deleted interface b8616500-11c9-4ea0-a472-839831230b20; detaching it from the instance and deleting it from the info cache
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.network.neutron [req-d6717ae2-0961-4929-859f-e51da0ae74f7 req-769cba21-7e90-4b4d-bee8-ac69a0f12afb service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-d6717ae2-0961-4929-859f-e51da0ae74f7 req-769cba21-7e90-4b4d-bee8-ac69a0f12afb service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Detach interface failed, port_id=b8616500-11c9-4ea0-a472-839831230b20, reason: Instance 2e75e82b-9455-411f-92e0-e9b831f23a34 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:59:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:38 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Deleted allocations for instance 2e75e82b-9455-411f-92e0-e9b831f23a34
Aug 26 17:59:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2cc6ae7e-1609-4efb-8069-8d0fc216731a tempest-ServerActionsTestOtherA-1020251450 tempest-ServerActionsTestOtherA-1020251450-project-member] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] Acquiring lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] Lock "2e75e82b-9455-411f-92e0-e9b831f23a34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:39 user nova-compute[73110]: DEBUG nova.compute.manager [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] No waiting events found dispatching network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:39 user nova-compute[73110]: WARNING nova.compute.manager [req-366e3ec6-3a91-4d1d-bcf9-274b1303d707 req-5a833c83-3ec9-41cf-a2b5-35d29ec5a1a2 service nova] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Received unexpected event network-vif-plugged-b8616500-11c9-4ea0-a472-839831230b20 for instance with vm_state deleted and task_state None.
Aug 26 17:59:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:59:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Creating image(s)
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Ensure instance console log exists: /opt/stack/data/nova/instances/863369e8-8359-44e5-8e6f-bbae8ec8f768/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Start _get_guest_xml network_info=[{"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '140f7e31-e53c-4410-a531-40f15f86ed8d', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuThdULJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '863369e8-8359-44e5-8e6f-bbae8ec8f768', 'attached_at': '', 'detached_at': '', 'volume_id': '57062aed-2090-4ec1-8fec-2041843b3baa', 'serial': '57062aed-2090-4ec1-8fec-2041843b3baa'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:59:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuThdULJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:59:43 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:59:43 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:59:43 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836f3fa-55b0-4817-b47f-d246228ac79f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:59:43 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39c46f-bd39-4c2d-9682-fa0162aab96b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa] added
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85a5cb-1ef2-46d0-bc07-feb5511253e2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1999d0a0-91f9-41b0-a8b1-746980784a42]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuThdULJ {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuThdULJ" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8cc97-3896-46c8-a055-be9ffdb731ca]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kuThdULJ'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2476de-fd01-4504-b226-76df8fbfe85a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1d767-f899-49aa-a9ed-110ba538f2e6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba3e395-ed2f-4cb2-96c7-0c341f66a831]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260]
Aug 26 17:59:43 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260] successful.
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d95ae9-4555-4084-841e-6c96506c2677]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e476eeb7-fba9-45fd-a5d1-a5b5969bbde9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:59:43 user nova-compute[73110]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 17:59:43 user nova-compute[73110]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)
Aug 26 17:59:43 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c787cc0d-28ae-4c51-aeff-9afad3114e69]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:59:43 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuThdULJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23338656431333630', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656431333630', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936656231',display_name='tempest-TestVolumeBootPattern-server-1936656231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936656231',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-jno9f18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:59:16Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=863369e8-8359-44e5-8e6f-bbae8ec8f768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid 863369e8-8359-44e5-8e6f-bbae8ec8f768 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:59:44 user nova-compute[73110]:   <uuid>863369e8-8359-44e5-8e6f-bbae8ec8f768</uuid>
Aug 26 17:59:44 user nova-compute[73110]:   <name>instance-00000024</name>
Aug 26 17:59:44 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 17:59:44 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 17:59:44 user nova-compute[73110]:   <metadata>
Aug 26 17:59:44 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:59:44 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 17:59:44 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-server-1936656231</nova:name>
Aug 26 17:59:44 user nova-compute[73110]:       <nova:creationTime>2023-08-26 17:59:43</nova:creationTime>
Aug 26 17:59:44 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 17:59:44 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:59:44 user nova-compute[73110]:       </nova:flavor>
Aug 26 17:59:44 user nova-compute[73110]:       <nova:owner>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 17:59:44 user nova-compute[73110]:       </nova:owner>
Aug 26 17:59:44 user nova-compute[73110]:       <nova:ports>
Aug 26 17:59:44 user nova-compute[73110]:         <nova:port uuid="554f831f-e7a9-4f1f-be1b-746176e8811e">
Aug 26 17:59:44 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 17:59:44 user nova-compute[73110]:         </nova:port>
Aug 26 17:59:44 user nova-compute[73110]:       </nova:ports>
Aug 26 17:59:44 user nova-compute[73110]:     </nova:instance>
Aug 26 17:59:44 user nova-compute[73110]:   </metadata>
Aug 26 17:59:44 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 17:59:44 user nova-compute[73110]:     <system>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="serial">863369e8-8359-44e5-8e6f-bbae8ec8f768</entry>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="uuid">863369e8-8359-44e5-8e6f-bbae8ec8f768</entry>
Aug 26 17:59:44 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:59:44 user nova-compute[73110]:     </system>
Aug 26 17:59:44 user nova-compute[73110]:   </sysinfo>
Aug 26 17:59:44 user nova-compute[73110]:   <os>
Aug 26 17:59:44 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:59:44 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 17:59:44 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 17:59:44 user nova-compute[73110]:   </os>
Aug 26 17:59:44 user nova-compute[73110]:   <features>
Aug 26 17:59:44 user nova-compute[73110]:     <acpi/>
Aug 26 17:59:44 user nova-compute[73110]:     <apic/>
Aug 26 17:59:44 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 17:59:44 user nova-compute[73110]:   </features>
Aug 26 17:59:44 user nova-compute[73110]:   <clock offset="utc">
Aug 26 17:59:44 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:59:44 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:59:44 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 17:59:44 user nova-compute[73110]:   </clock>
Aug 26 17:59:44 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 17:59:44 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 17:59:44 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:59:44 user nova-compute[73110]:   </cpu>
Aug 26 17:59:44 user nova-compute[73110]:   <devices>
Aug 26 17:59:44 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 17:59:44 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:59:44 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 17:59:44 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 17:59:44 user nova-compute[73110]:       <serial>57062aed-2090-4ec1-8fec-2041843b3baa</serial>
Aug 26 17:59:44 user nova-compute[73110]:     </disk>
Aug 26 17:59:44 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 17:59:44 user nova-compute[73110]:       <mac address="fa:16:3e:4e:52:1d"/>
Aug 26 17:59:44 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:59:44 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 17:59:44 user nova-compute[73110]:       <target dev="tap554f831f-e7"/>
Aug 26 17:59:44 user nova-compute[73110]:     </interface>
Aug 26 17:59:44 user nova-compute[73110]:     <serial type="pty">
Aug 26 17:59:44 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/863369e8-8359-44e5-8e6f-bbae8ec8f768/console.log" append="off"/>
Aug 26 17:59:44 user nova-compute[73110]:     </serial>
Aug 26 17:59:44 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:59:44 user nova-compute[73110]:     <video>
Aug 26 17:59:44 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 17:59:44 user nova-compute[73110]:     </video>
Aug 26 17:59:44 user nova-compute[73110]:     <rng model="virtio">
Aug 26 17:59:44 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:59:44 user nova-compute[73110]:     </rng>
Aug 26 17:59:44 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:59:44 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 17:59:44 user nova-compute[73110]:       <stats period="10"/>
Aug 26 17:59:44 user nova-compute[73110]:     </memballoon>
Aug 26 17:59:44 user nova-compute[73110]:   </devices>
Aug 26 17:59:44 user nova-compute[73110]: </domain>
Aug 26 17:59:44 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936656231',display_name='tempest-TestVolumeBootPattern-server-1936656231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936656231',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-jno9f18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:59:16Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=863369e8-8359-44e5-8e6f-bbae8ec8f768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG os_vif [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap554f831f-e7, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap554f831f-e7, col_values=(('external_ids', {'iface-id': '554f831f-e7a9-4f1f-be1b-746176e8811e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:52:1d', 'vm-uuid': '863369e8-8359-44e5-8e6f-bbae8ec8f768'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:44 user nova-compute[73110]: INFO os_vif [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7')
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:59:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:4e:52:1d, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG nova.compute.manager [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: INFO nova.compute.manager [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] instance snapshotting
Aug 26 17:59:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Beginning live snapshot process
Aug 26 17:59:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] No waiting events found dispatching network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:46 user nova-compute[73110]: WARNING nova.compute.manager [req-650b7da6-fc36-4984-bc28-815aed20a14e req-69d4d6dc-17f8-424e-9f56-da055caf14c5 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received unexpected event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e for instance with vm_state building and task_state spawning.
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.169s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f.delta 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f.delta 1073741824" returned: 0 in 0.059s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:47 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 17:59:47 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] No waiting events found dispatching network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:59:48 user nova-compute[73110]: WARNING nova.compute.manager [req-747b3c01-11f1-426e-8531-90f7c837ce61 req-2807ba3d-03f0-42a6-aeb7-24ba7547931b service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received unexpected event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e for instance with vm_state building and task_state spawning.
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f.delta /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072788.5928547, 863369e8-8359-44e5-8e6f-bbae8ec8f768 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] VM Resumed (Lifecycle Event)
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Instance spawned successfully.
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072788.6031454, 863369e8-8359-44e5-8e6f-bbae8ec8f768 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] VM Started (Lifecycle Event)
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:59:48 user nova-compute[73110]: INFO nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 26 17:59:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:49 user nova-compute[73110]: INFO nova.compute.manager [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Took 33.99 seconds to build instance.
Aug 26 17:59:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f.delta /opt/stack/data/nova/instances/snapshots/tmpi5ndc0ce/dc4b93fe9f144bf49eecffe967fb1a6f" returned: 0 in 0.552s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:59:49 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Snapshot extracted, beginning image upload
Aug 26 17:59:49 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1582eb49-86d4-4599-9985-d28a6f828945 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.109s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:59:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:51 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Snapshot image upload complete
Aug 26 17:59:51 user nova-compute[73110]: INFO nova.compute.manager [None req-87110938-cd42-4041-acbb-93690586ae49 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Took 5.30 seconds to snapshot the instance on the hypervisor.
Aug 26 17:59:52 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072777.6255698, 2e75e82b-9455-411f-92e0-e9b831f23a34 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:59:52 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] VM Stopped (Lifecycle Event)
Aug 26 17:59:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a5403b10-ae2f-477b-929e-c571d5b9267b None None] [instance: 2e75e82b-9455-411f-92e0-e9b831f23a34] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:59:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:59:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:00:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:00:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:00:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:10 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:00:10 user nova-compute[73110]: INFO nova.compute.claims [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Claim successful on node user
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.policy [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93d440884f084d1880b629e9e46bc9a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a95807be6c4df386c3d4f48cd9c3f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:00:11 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Creating image(s)
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "/opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "/opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "/opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.213s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk 1073741824" returned: 0 in 0.073s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Successfully created port: bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Cannot resize image /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Ensure instance console log exists: /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Successfully updated port: bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquired lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-changed-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Refreshing instance network info cache due to event network-changed-bc33bdb3-5cdd-462e-9f47-26f902c1ae92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] Acquiring lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Updating instance_info_cache with network_info: [{"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:00:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:00:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.130027770996094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Releasing lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Instance network_info: |[{"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] Acquired lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Refreshing network info cache for port bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Start _get_guest_xml network_info=[{"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:00:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:00:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1663621091',display_name='tempest-VolumesActionsTest-instance-1663621091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1663621091',id=37,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32a95807be6c4df386c3d4f48cd9c3f6',ramdisk_id='',reservation_id='r-jxz1mu62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2127884468',owner_user_name='tempest-VolumesActionsTest-2127884468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:00:11Z,user_data=None,user_id='93d440884f084d1880b629e9e46bc9a3',uuid=7af95a7a-596c-4a04-b178-870d8ca535f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converting VIF {"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lazy-loading 'pci_devices' on Instance uuid 7af95a7a-596c-4a04-b178-870d8ca535f5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:00:14 user nova-compute[73110]:   <uuid>7af95a7a-596c-4a04-b178-870d8ca535f5</uuid>
Aug 26 18:00:14 user nova-compute[73110]:   <name>instance-00000025</name>
Aug 26 18:00:14 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:00:14 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:00:14 user nova-compute[73110]:   <metadata>
Aug 26 18:00:14 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:00:14 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:name>tempest-VolumesActionsTest-instance-1663621091</nova:name>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:00:14</nova:creationTime>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:00:14 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:00:14 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:owner>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:user uuid="93d440884f084d1880b629e9e46bc9a3">tempest-VolumesActionsTest-2127884468-project-member</nova:user>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:project uuid="32a95807be6c4df386c3d4f48cd9c3f6">tempest-VolumesActionsTest-2127884468</nova:project>
Aug 26 18:00:14 user nova-compute[73110]:       </nova:owner>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:00:14 user nova-compute[73110]:       <nova:ports>
Aug 26 18:00:14 user nova-compute[73110]:         <nova:port uuid="bc33bdb3-5cdd-462e-9f47-26f902c1ae92">
Aug 26 18:00:14 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 18:00:14 user nova-compute[73110]:         </nova:port>
Aug 26 18:00:14 user nova-compute[73110]:       </nova:ports>
Aug 26 18:00:14 user nova-compute[73110]:     </nova:instance>
Aug 26 18:00:14 user nova-compute[73110]:   </metadata>
Aug 26 18:00:14 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:00:14 user nova-compute[73110]:     <system>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="serial">7af95a7a-596c-4a04-b178-870d8ca535f5</entry>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="uuid">7af95a7a-596c-4a04-b178-870d8ca535f5</entry>
Aug 26 18:00:14 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:00:14 user nova-compute[73110]:     </system>
Aug 26 18:00:14 user nova-compute[73110]:   </sysinfo>
Aug 26 18:00:14 user nova-compute[73110]:   <os>
Aug 26 18:00:14 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:00:14 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:00:14 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:00:14 user nova-compute[73110]:   </os>
Aug 26 18:00:14 user nova-compute[73110]:   <features>
Aug 26 18:00:14 user nova-compute[73110]:     <acpi/>
Aug 26 18:00:14 user nova-compute[73110]:     <apic/>
Aug 26 18:00:14 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:00:14 user nova-compute[73110]:   </features>
Aug 26 18:00:14 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:00:14 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:00:14 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:00:14 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:00:14 user nova-compute[73110]:   </clock>
Aug 26 18:00:14 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:00:14 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:00:14 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:00:14 user nova-compute[73110]:   </cpu>
Aug 26 18:00:14 user nova-compute[73110]:   <devices>
Aug 26 18:00:14 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:00:14 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:00:14 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk"/>
Aug 26 18:00:14 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:00:14 user nova-compute[73110]:     </disk>
Aug 26 18:00:14 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:00:14 user nova-compute[73110]:       <mac address="fa:16:3e:7c:c5:83"/>
Aug 26 18:00:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:00:14 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:00:14 user nova-compute[73110]:       <target dev="tapbc33bdb3-5c"/>
Aug 26 18:00:14 user nova-compute[73110]:     </interface>
Aug 26 18:00:14 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:00:14 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/console.log" append="off"/>
Aug 26 18:00:14 user nova-compute[73110]:     </serial>
Aug 26 18:00:14 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:00:14 user nova-compute[73110]:     <video>
Aug 26 18:00:14 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:00:14 user nova-compute[73110]:     </video>
Aug 26 18:00:14 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:00:14 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:00:14 user nova-compute[73110]:     </rng>
Aug 26 18:00:14 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:00:14 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:00:14 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:00:14 user nova-compute[73110]:     </memballoon>
Aug 26 18:00:14 user nova-compute[73110]:   </devices>
Aug 26 18:00:14 user nova-compute[73110]: </domain>
Aug 26 18:00:14 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1663621091',display_name='tempest-VolumesActionsTest-instance-1663621091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1663621091',id=37,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32a95807be6c4df386c3d4f48cd9c3f6',ramdisk_id='',reservation_id='r-jxz1mu62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2127884468',owner_user_name='tempest-VolumesActionsTest-2127884468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:00:11Z,user_data=None,user_id='93d440884f084d1880b629e9e46bc9a3',uuid=7af95a7a-596c-4a04-b178-870d8ca535f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converting VIF {"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG os_vif [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc33bdb3-5c, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc33bdb3-5c, col_values=(('external_ids', {'iface-id': 'bc33bdb3-5cdd-462e-9f47-26f902c1ae92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c5:83', 'vm-uuid': '7af95a7a-596c-4a04-b178-870d8ca535f5'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:14 user nova-compute[73110]: INFO os_vif [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c')
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 863369e8-8359-44e5-8e6f-bbae8ec8f768 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7af95a7a-596c-4a04-b178-870d8ca535f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] No VIF found with MAC fa:16:3e:7c:c5:83, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Updated VIF entry in instance network info cache for port bc33bdb3-5cdd-462e-9f47-26f902c1ae92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Updating instance_info_cache with network_info: [{"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:00:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e292c80b-5bf6-45e1-90c1-0a80206d5ac6 req-a77ed1d0-ab6c-4ba7-9e69-832151d67058 service nova] Releasing lock "refresh_cache-7af95a7a-596c-4a04-b178-870d8ca535f5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:00:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] No waiting events found dispatching network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:00:16 user nova-compute[73110]: WARNING nova.compute.manager [req-df033189-eb81-4d6a-b33b-54bfb87cf73a req-c4d4d8ef-5732-4028-ba6b-af5da7ede5e7 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received unexpected event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 for instance with vm_state building and task_state spawning.
Aug 26 18:00:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072818.1648114, 7af95a7a-596c-4a04-b178-870d8ca535f5 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] VM Resumed (Lifecycle Event)
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Instance spawned successfully.
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] No waiting events found dispatching network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:00:18 user nova-compute[73110]: WARNING nova.compute.manager [req-88d10272-6bb0-453a-be82-e46265d043e8 req-5c8f4917-f6a8-44a7-9edc-c66374ddf814 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received unexpected event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 for instance with vm_state building and task_state spawning.
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072818.168274, 7af95a7a-596c-4a04-b178-870d8ca535f5 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] VM Started (Lifecycle Event)
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 26 18:00:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:00:18 user nova-compute[73110]: INFO nova.compute.manager [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Took 7.75 seconds to build instance.
Aug 26 18:00:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d889f3ea-ebc1-463b-96f6-2704cf72d376 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.857s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:00:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing instance network info cache due to event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG nova.objects.instance [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'flavor' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:00:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:53 user nova-compute[73110]: INFO nova.compute.manager [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Attaching volume 6b527daa-c8eb-4041-9cb9-93f261e3f32a to /dev/vdb
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.utils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ce986-6ff7-4243-bb22-ab5cfa0da38d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbdbdd-8a33-4ff6-bd15-338345da2df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a700e0c-f788-4e45-a4f3-f679acab1a6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b8ed7-0a71-44f9-8d30-c852da09f19e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:00:53 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:00:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updated VIF entry in instance network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec82d9-51cc-49fd-bc1f-4df4b5ffc287]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG os_brick.utils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating existing volume attachment record: f63559c6-775d-4802-bf98-15e47d5a063b {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-faeae6c6-360f-47e3-b700-2a2dc920a823 req-f4f2690f-4683-4de2-9e52-c588b750c94c service nova] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:00:54 user nova-compute[73110]: INFO nova.compute.claims [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Claim successful on node user
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:00:54 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:00:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:00:54 user nova-compute[73110]: INFO nova.virt.block_device [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Booting with volume-backed-image 4299a158-616a-46c3-b665-9d8a5d47a509 at /dev/vda
Aug 26 18:00:54 user nova-compute[73110]: DEBUG nova.policy [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '095465fef30b4fd0a144cb5b7c4ffb7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef6ddc676bd48e4886079097e3e0d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:00:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Successfully created port: 363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Successfully updated port: 363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-changed-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Refreshing instance network info cache due to event network-changed-363252b1-b8e9-4647-82d5-b112af68533d. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:00:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] Acquiring lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance network_info: |[{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] Acquired lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Refreshing network info cache for port 363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updated VIF entry in instance network info cache for port 363252b1-b8e9-4647-82d5-b112af68533d. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:00:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-06caeb78-8b78-4938-b861-135f84cba29f req-794945be-9179-4fb1-bc3d-68f854116b05 service nova] Releasing lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:00:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:00:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:01:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:05 user nova-compute[73110]: INFO nova.compute.manager [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Terminating instance
Aug 26 18:01:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-unplugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] No waiting events found dispatching network-vif-unplugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-26f7212d-d825-46df-9eca-c2cbc05f7c4d req-fe6fe21f-d79f-4b1d-a033-6823f4a240c1 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-unplugged-554f831f-e7a9-4f1f-be1b-746176e8811e for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:01:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Instance destroyed successfully.
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.objects.instance [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid 863369e8-8359-44e5-8e6f-bbae8ec8f768 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1936656231',display_name='tempest-TestVolumeBootPattern-server-1936656231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1936656231',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-jno9f18j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:59:49Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=863369e8-8359-44e5-8e6f-bbae8ec8f768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "554f831f-e7a9-4f1f-be1b-746176e8811e", "address": "fa:16:3e:4e:52:1d", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554f831f-e7", "ovs_interfaceid": "554f831f-e7a9-4f1f-be1b-746176e8811e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_vif [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap554f831f-e7, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:01:06 user nova-compute[73110]: INFO os_vif [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:1d,bridge_name='br-int',has_traffic_filtering=True,id=554f831f-e7a9-4f1f-be1b-746176e8811e,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554f831f-e7')
Aug 26 18:01:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuThdULJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:01:06 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37973b-292b-4296-9249-5f4d38a8d502]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c37444-b421-41bf-b193-0fbdf0601b7f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:06 user nova-compute[73110]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)
Aug 26 18:01:06 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:06 user nova-compute[73110]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa (non-flash)
Aug 26 18:01:06 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441a9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af82b4-1395-4682-a1b3-36987389bd0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b5a66-00cf-4fb6-aa37-271678ca0dcf]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef0addb-1936-4a7f-a0c9-4213de96f067]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad18453-7a42-4f18-b39e-2914ca5319f1]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23338656431333630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d5f0f48', '/dev/disk/by-id/scsi-1SCST_BIO2d5f0f48-38ed1360e43897d2') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9821be-1a04-41c8-a686-8211ef3433d7]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f5e71-f8e4-4551-8475-5e4ffa8da200]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f591f764-e23b-452d-bf4e-8b6941d83764]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260]
Aug 26 18:01:07 user nova-compute[73110]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa, portal: 172.16.0.220,3260] successful.
Aug 26 18:01:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57062aed-2090-4ec1-8fec-2041843b3baa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f56354-a0b7-420d-91cb-6f6d94bb5dfc]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (329ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:01:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Deleting instance files /opt/stack/data/nova/instances/863369e8-8359-44e5-8e6f-bbae8ec8f768_del
Aug 26 18:01:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Deletion of /opt/stack/data/nova/instances/863369e8-8359-44e5-8e6f-bbae8ec8f768_del complete
Aug 26 18:01:07 user nova-compute[73110]: INFO nova.compute.manager [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:07 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:01:07 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Took 0.57 seconds to deallocate network for instance.
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] Acquiring lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] No waiting events found dispatching network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:08 user nova-compute[73110]: WARNING nova.compute.manager [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received unexpected event network-vif-plugged-554f831f-e7a9-4f1f-be1b-746176e8811e for instance with vm_state active and task_state deleting.
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c6b2c39-4c96-459a-9ed1-5b2613a1820c req-9f4ed0e5-8539-43cd-95fc-d3ff28c174c0 service nova] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Received event network-vif-deleted-554f831f-e7a9-4f1f-be1b-746176e8811e {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:08 user nova-compute[73110]: INFO nova.compute.manager [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Deleting volume: 57062aed-2090-4ec1-8fec-2041843b3baa {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEfPmWdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:01:08 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:01:08 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:01:08 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057d879-b584-46c5-a12a-232775f52afe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:01:08 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e0d99-1263-427d-a5e5-a5ca176cf212]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a] added
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a11a9-9bea-4696-b013-44fdcbb04469]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb4e1b-f8f2-42ed-9ce9-34ba3fd2f28b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zEfPmWdk {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zEfPmWdk" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b61e18-735a-42eb-8f1c-a15db98d0b91]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zEfPmWdk'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497930e-52da-4ab9-a77d-bde172b3f9ec]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[976e9355-e279-43d2-98f8-3cfe8b1e03e2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5301c86d-6f8d-4bca-922a-35456009b096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260]
Aug 26 18:01:08 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260] successful.
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[59882410-c754-45f3-8e9f-e168bd03dc8d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c53b3-95f6-49a4-a7b8-de728820355c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:08 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:08 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:08 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf4f28b-fcb4-4af8-9fcc-df1770974afd]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:01:08 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.736s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:09 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance 863369e8-8359-44e5-8e6f-bbae8ec8f768
Aug 26 18:01:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-234461c4-69d1-4ee3-8073-a26712719bd4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "863369e8-8359-44e5-8e6f-bbae8ec8f768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.669s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEfPmWdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23661333035623737', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661333035623737', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'flavor' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:01:09 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:01:09 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:01:09 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:01:09 user nova-compute[73110]:   <serial>6b527daa-c8eb-4041-9cb9-93f261e3f32a</serial>
Aug 26 18:01:09 user nova-compute[73110]: </disk>
Aug 26 18:01:09 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:59:4a:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:01:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-378714ce-b202-47d3-801d-52e02cb0af8a tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.501s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:11 user nova-compute[73110]: INFO nova.compute.manager [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Rescuing
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:12 user nova-compute[73110]: WARNING nova.compute.manager [req-1457a2b0-014a-4b28-8b62-064241d8f9ef req-3d063bf4-7076-41ef-affa-ddefde098fc4 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state active and task_state rescuing.
Aug 26 18:01:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance destroyed successfully.
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Attempting rescue
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 18:01:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Creating image(s)
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'trusted_certs' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue" returned: 0 in 0.053s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'migration_context' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.base [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<158e68cf-4eba-4b8b-956c-4eeff158119b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start _get_guest_xml network_info=[{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:59:4a:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.base [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<158e68cf-4eba-4b8b-956c-4eeff158119b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'numa_topology' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.base [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<158e68cf-4eba-4b8b-956c-4eeff158119b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:01:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:13 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'vcpu_model' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.base [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<158e68cf-4eba-4b8b-956c-4eeff158119b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-19789833',display_name='tempest-ServerRescueNegativeTestJSON-server-19789833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-19789833',id=35,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqTVYxY6AZqGuMrgmAHbd5F1aKTfzf8+/H6j545GJXhO1/wLJ5skKl+NBjGQ/TpfbFdz3L/TZSitHHX72pR8a3BJo676S7GrKbgcgMbZQGL1M3ppvexjD02HbfaxMJiKg==',key_name='tempest-keypair-662086693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:59:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-wwzx9dii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=158e68cf-4eba-4b8b-956c-4eeff158119b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:59:4a:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "vif_mac": "fa:16:3e:59:4a:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'pci_devices' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.objects.base [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Object Instance<158e68cf-4eba-4b8b-956c-4eeff158119b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:01:13 user nova-compute[73110]:   <uuid>158e68cf-4eba-4b8b-956c-4eeff158119b</uuid>
Aug 26 18:01:13 user nova-compute[73110]:   <name>instance-00000023</name>
Aug 26 18:01:13 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:01:13 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:01:13 user nova-compute[73110]:   <metadata>
Aug 26 18:01:13 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:01:13 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-19789833</nova:name>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:01:13</nova:creationTime>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:01:13 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:01:13 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:owner>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:user uuid="4a8aa997bb214e5f9aa5fd0badb394be">tempest-ServerRescueNegativeTestJSON-1378027755-project-member</nova:user>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:project uuid="c5fcf35a12ef444b87aff6fa79bff21a">tempest-ServerRescueNegativeTestJSON-1378027755</nova:project>
Aug 26 18:01:13 user nova-compute[73110]:       </nova:owner>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:01:13 user nova-compute[73110]:       <nova:ports>
Aug 26 18:01:13 user nova-compute[73110]:         <nova:port uuid="065c6b2d-1fe3-4338-ab38-06c1b57c2a59">
Aug 26 18:01:13 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 18:01:13 user nova-compute[73110]:         </nova:port>
Aug 26 18:01:13 user nova-compute[73110]:       </nova:ports>
Aug 26 18:01:13 user nova-compute[73110]:     </nova:instance>
Aug 26 18:01:13 user nova-compute[73110]:   </metadata>
Aug 26 18:01:13 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:01:13 user nova-compute[73110]:     <system>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="serial">158e68cf-4eba-4b8b-956c-4eeff158119b</entry>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="uuid">158e68cf-4eba-4b8b-956c-4eeff158119b</entry>
Aug 26 18:01:13 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:01:13 user nova-compute[73110]:     </system>
Aug 26 18:01:13 user nova-compute[73110]:   </sysinfo>
Aug 26 18:01:13 user nova-compute[73110]:   <os>
Aug 26 18:01:13 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:01:13 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:01:13 user nova-compute[73110]:   </os>
Aug 26 18:01:13 user nova-compute[73110]:   <features>
Aug 26 18:01:13 user nova-compute[73110]:     <acpi/>
Aug 26 18:01:13 user nova-compute[73110]:     <apic/>
Aug 26 18:01:13 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:01:13 user nova-compute[73110]:   </features>
Aug 26 18:01:13 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:01:13 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:01:13 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:01:13 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:01:13 user nova-compute[73110]:   </clock>
Aug 26 18:01:13 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:01:13 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:01:13 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:01:13 user nova-compute[73110]:   </cpu>
Aug 26 18:01:13 user nova-compute[73110]:   <devices>
Aug 26 18:01:13 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:01:13 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:01:13 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue"/>
Aug 26 18:01:13 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:01:13 user nova-compute[73110]:     </disk>
Aug 26 18:01:13 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:01:13 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:01:13 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk"/>
Aug 26 18:01:13 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 18:01:13 user nova-compute[73110]:     </disk>
Aug 26 18:01:13 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:01:13 user nova-compute[73110]:       <mac address="fa:16:3e:59:4a:4f"/>
Aug 26 18:01:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:01:13 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:01:13 user nova-compute[73110]:       <target dev="tap065c6b2d-1f"/>
Aug 26 18:01:13 user nova-compute[73110]:     </interface>
Aug 26 18:01:13 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:01:13 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/console.log" append="off"/>
Aug 26 18:01:13 user nova-compute[73110]:     </serial>
Aug 26 18:01:13 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:01:13 user nova-compute[73110]:     <video>
Aug 26 18:01:13 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:01:13 user nova-compute[73110]:     </video>
Aug 26 18:01:13 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:01:13 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:01:13 user nova-compute[73110]:     </rng>
Aug 26 18:01:13 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:01:13 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:01:13 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:01:13 user nova-compute[73110]:     </memballoon>
Aug 26 18:01:13 user nova-compute[73110]:   </devices>
Aug 26 18:01:13 user nova-compute[73110]: </domain>
Aug 26 18:01:13 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:01:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance destroyed successfully.
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] No VIF found with MAC fa:16:3e:59:4a:4f, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:01:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:14 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.088909149169922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 7af95a7a-596c-4a04-b178-870d8ca535f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:01:14 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:15 user nova-compute[73110]: WARNING nova.compute.manager [req-efdcaf17-9834-4930-ad0d-fc9724504d30 req-060b2288-308c-4fbd-9ca5-99fad1136592 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state active and task_state rescuing.
Aug 26 18:01:15 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:17 user nova-compute[73110]: WARNING nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state active and task_state rescuing.
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:17 user nova-compute[73110]: WARNING nova.compute.manager [req-634cda8b-dfa2-43b5-aa6c-518490288c75 req-44ca14da-76b1-40a6-a0e8-d8fbdd497e85 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state active and task_state rescuing.
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 158e68cf-4eba-4b8b-956c-4eeff158119b due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072877.7869065, 158e68cf-4eba-4b8b-956c-4eeff158119b => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:01:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Resumed (Lifecycle Event)
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2c0a276e-9553-4c93-857e-698d91952b4c tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:01:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072877.7881856, 158e68cf-4eba-4b8b-956c-4eeff158119b => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:01:17 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Started (Lifecycle Event)
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:01:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.utils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d497b823-31e1-4b09-b003-bebb223eb2ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312f02a-0fd3-4b89-818f-3d617ab12a3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[500520e2-43b2-4872-88f7-8d329d5243ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[048df77b-d84a-4c6b-ba7a-63740ad11f3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:01:20 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:01:20 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72644ed-d66d-42c6-9c27-c90a0d4e7230]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG os_brick.utils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:01:20 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating existing volume attachment record: f047010a-4a8d-49c6-b2a6-9494af789515 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:01:21 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072866.6667957, 863369e8-8359-44e5-8e6f-bbae8ec8f768 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:01:21 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] VM Stopped (Lifecycle Event)
Aug 26 18:01:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-2fe7809f-d738-4093-a82a-f7788211e1d5 None None] [instance: 863369e8-8359-44e5-8e6f-bbae8ec8f768] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:01:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:01:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:01:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:01:33 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Creating image(s)
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Ensure instance console log exists: /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start _get_guest_xml network_info=[{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f047010a-4a8d-49c6-b2a6-9494af789515', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6aca42c-964c-4f78-b4c7-84457922c215', 'attached_at': '', 'detached_at': '', 'volume_id': '6097158a-f767-4531-a6d4-d7ddfcd41c79', 'serial': '6097158a-f767-4531-a6d4-d7ddfcd41c79'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:01:33 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:33 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:01:33 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:01:33 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:01:33 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa657738-61f6-4108-a9d2-bdbc530b99f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:01:33 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408fee7-54a7-4853-88bb-db1ecf383b4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79] added
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68f09a-bb39-4ea6-a290-04d4b22c141d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59de539-3a21-4063-84f2-ab77775a9f09]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqgLptKN {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqgLptKN" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1075db-89ca-4984-a3d7-7257d8d83b01]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqgLptKN'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d47ace-dfda-42b3-88ff-2c94c87fb80d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddadd8e-ae43-420a-91a7-e77d50423331]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ffc7f3-74b7-46c9-91ec-b9e0a63b83d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260]
Aug 26 18:01:33 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260] successful.
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa56c4-91d9-4db1-9a7b-45214aa415d3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2922bea0-c53c-4370-a408-dc512500f411]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:01:33 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:01:33 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5691f161-8416-4e4d-a59a-64b22a265b2a]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:01:33 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26266666634326235', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266666634326235', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1630820214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1630820214',id=38,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-0bghsrgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:00:55Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=e6aca42c-964c-4f78-b4c7-84457922c215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:01:34 user nova-compute[73110]:   <uuid>e6aca42c-964c-4f78-b4c7-84457922c215</uuid>
Aug 26 18:01:34 user nova-compute[73110]:   <name>instance-00000026</name>
Aug 26 18:01:34 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:01:34 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:01:34 user nova-compute[73110]:   <metadata>
Aug 26 18:01:34 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:01:34 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1630820214</nova:name>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:01:33</nova:creationTime>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:01:34 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:01:34 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:owner>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 18:01:34 user nova-compute[73110]:       </nova:owner>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:01:34 user nova-compute[73110]:       <nova:ports>
Aug 26 18:01:34 user nova-compute[73110]:         <nova:port uuid="363252b1-b8e9-4647-82d5-b112af68533d">
Aug 26 18:01:34 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 18:01:34 user nova-compute[73110]:         </nova:port>
Aug 26 18:01:34 user nova-compute[73110]:       </nova:ports>
Aug 26 18:01:34 user nova-compute[73110]:     </nova:instance>
Aug 26 18:01:34 user nova-compute[73110]:   </metadata>
Aug 26 18:01:34 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:01:34 user nova-compute[73110]:     <system>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="serial">e6aca42c-964c-4f78-b4c7-84457922c215</entry>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="uuid">e6aca42c-964c-4f78-b4c7-84457922c215</entry>
Aug 26 18:01:34 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:01:34 user nova-compute[73110]:     </system>
Aug 26 18:01:34 user nova-compute[73110]:   </sysinfo>
Aug 26 18:01:34 user nova-compute[73110]:   <os>
Aug 26 18:01:34 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:01:34 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:01:34 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:01:34 user nova-compute[73110]:   </os>
Aug 26 18:01:34 user nova-compute[73110]:   <features>
Aug 26 18:01:34 user nova-compute[73110]:     <acpi/>
Aug 26 18:01:34 user nova-compute[73110]:     <apic/>
Aug 26 18:01:34 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:01:34 user nova-compute[73110]:   </features>
Aug 26 18:01:34 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:01:34 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:01:34 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:01:34 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:01:34 user nova-compute[73110]:   </clock>
Aug 26 18:01:34 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:01:34 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:01:34 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:01:34 user nova-compute[73110]:   </cpu>
Aug 26 18:01:34 user nova-compute[73110]:   <devices>
Aug 26 18:01:34 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:01:34 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:01:34 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 18:01:34 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:01:34 user nova-compute[73110]:       <serial>6097158a-f767-4531-a6d4-d7ddfcd41c79</serial>
Aug 26 18:01:34 user nova-compute[73110]:     </disk>
Aug 26 18:01:34 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:01:34 user nova-compute[73110]:       <mac address="fa:16:3e:26:c2:4b"/>
Aug 26 18:01:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:01:34 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:01:34 user nova-compute[73110]:       <target dev="tap363252b1-b8"/>
Aug 26 18:01:34 user nova-compute[73110]:     </interface>
Aug 26 18:01:34 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:01:34 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/console.log" append="off"/>
Aug 26 18:01:34 user nova-compute[73110]:     </serial>
Aug 26 18:01:34 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:01:34 user nova-compute[73110]:     <video>
Aug 26 18:01:34 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:01:34 user nova-compute[73110]:     </video>
Aug 26 18:01:34 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:01:34 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:01:34 user nova-compute[73110]:     </rng>
Aug 26 18:01:34 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:01:34 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:01:34 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:01:34 user nova-compute[73110]:     </memballoon>
Aug 26 18:01:34 user nova-compute[73110]:   </devices>
Aug 26 18:01:34 user nova-compute[73110]: </domain>
Aug 26 18:01:34 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1630820214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1630820214',id=38,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-0bghsrgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:00:55Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=e6aca42c-964c-4f78-b4c7-84457922c215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG os_vif [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap363252b1-b8, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap363252b1-b8, col_values=(('external_ids', {'iface-id': '363252b1-b8e9-4647-82d5-b112af68533d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:c2:4b', 'vm-uuid': 'e6aca42c-964c-4f78-b4c7-84457922c215'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:34 user nova-compute[73110]: INFO os_vif [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8')
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:26:c2:4b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:01:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:36 user nova-compute[73110]: WARNING nova.compute.manager [req-c82f912c-9d0b-4075-8170-71f6a5aff811 req-6366fce9-1db6-4208-a7f0-fe8a5a226488 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state building and task_state spawning.
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072898.117765, e6aca42c-964c-4f78-b4c7-84457922c215 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Resumed (Lifecycle Event)
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance spawned successfully.
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072898.1223269, e6aca42c-964c-4f78-b4c7-84457922c215 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Started (Lifecycle Event)
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Took 5.15 seconds to spawn the instance on the hypervisor.
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:01:38 user nova-compute[73110]: INFO nova.compute.manager [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Took 44.29 seconds to build instance.
Aug 26 18:01:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d904910e-1d5c-4bca-a182-42392829464f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.432s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:01:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:01:38 user nova-compute[73110]: WARNING nova.compute.manager [req-0e825b49-02e1-40a9-ac9b-1f0c6aa4495a req-f1488ac2-b74b-4b98-9f72-a6af95916d8b service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state active and task_state None.
Aug 26 18:01:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:01:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:02:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:05 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [{"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-d7c5e50e-1035-438b-82c0-946cb4c36547" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:02:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:14 user nova-compute[73110]: INFO nova.compute.manager [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Terminating instance
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Instance destroyed successfully.
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lazy-loading 'resources' on Instance uuid 7af95a7a-596c-4a04-b178-870d8ca535f5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1663621091',display_name='tempest-VolumesActionsTest-instance-1663621091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1663621091',id=37,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:00:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32a95807be6c4df386c3d4f48cd9c3f6',ramdisk_id='',reservation_id='r-jxz1mu62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2127884468',owner_user_name='tempest-VolumesActionsTest-2127884468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:00:18Z,user_data=None,user_id='93d440884f084d1880b629e9e46bc9a3',uuid=7af95a7a-596c-4a04-b178-870d8ca535f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converting VIF {"id": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "address": "fa:16:3e:7c:c5:83", "network": {"id": "f6839b07-16db-484a-ad84-d50d3ba66223", "bridge": "br-int", "label": "tempest-VolumesActionsTest-931971553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32a95807be6c4df386c3d4f48cd9c3f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc33bdb3-5c", "ovs_interfaceid": "bc33bdb3-5cdd-462e-9f47-26f902c1ae92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG os_vif [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc33bdb3-5c, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-unplugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] No waiting events found dispatching network-vif-unplugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a995969-0bf3-4d90-98ef-cbbc188135d9 req-00e5acec-4b77-445f-9a32-3670dc983d01 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-unplugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:02:14 user nova-compute[73110]: INFO os_vif [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c5:83,bridge_name='br-int',has_traffic_filtering=True,id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92,network=Network(f6839b07-16db-484a-ad84-d50d3ba66223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc33bdb3-5c')
Aug 26 18:02:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Deleting instance files /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5_del
Aug 26 18:02:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Deletion of /opt/stack/data/nova/instances/7af95a7a-596c-4a04-b178-870d8ca535f5_del complete
Aug 26 18:02:14 user nova-compute[73110]: INFO nova.compute.manager [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-5e20ccd6-206d-4762-b008-182eabced5bd req-81674859-5133-4c16-be49-4c985816c017 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-deleted-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:15 user nova-compute[73110]: INFO nova.compute.manager [req-5e20ccd6-206d-4762-b008-182eabced5bd req-81674859-5133-4c16-be49-4c985816c017 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Neutron deleted interface bc33bdb3-5cdd-462e-9f47-26f902c1ae92; detaching it from the instance and deleting it from the info cache
Aug 26 18:02:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-5e20ccd6-206d-4762-b008-182eabced5bd req-81674859-5133-4c16-be49-4c985816c017 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:15 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Took 0.77 seconds to deallocate network for instance.
Aug 26 18:02:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-5e20ccd6-206d-4762-b008-182eabced5bd req-81674859-5133-4c16-be49-4c985816c017 service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Detach interface failed, port_id=bc33bdb3-5cdd-462e-9f47-26f902c1ae92, reason: Instance 7af95a7a-596c-4a04-b178-870d8ca535f5 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:16 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Deleted allocations for instance 7af95a7a-596c-4a04-b178-870d8ca535f5
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-978f7bf4-3887-433e-a72c-0b82559f08f0 tempest-VolumesActionsTest-2127884468 tempest-VolumesActionsTest-2127884468-project-member] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] Acquiring lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] Lock "7af95a7a-596c-4a04-b178-870d8ca535f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] No waiting events found dispatching network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:16 user nova-compute[73110]: WARNING nova.compute.manager [req-68242fae-916c-47bd-ae7e-83ce0e9a29f1 req-7a9295a3-bd75-41f5-ac7c-231ee23d174d service nova] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Received unexpected event network-vif-plugged-bc33bdb3-5cdd-462e-9f47-26f902c1ae92 for instance with vm_state deleted and task_state None.
Aug 26 18:02:16 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:16 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.083553314208984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:02:16 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:02:17 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:02:17 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:02:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:02:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:02:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:23 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:02:23 user nova-compute[73110]: INFO nova.compute.claims [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Claim successful on node user
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:02:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:02:24 user nova-compute[73110]: INFO nova.virt.block_device [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Booting with volume eb815c35-b127-47ed-b95b-4122f84a17c7 at /dev/vda
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.policy [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.utils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba4fd8a-071c-4423-877a-f57cd0bb784f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[343dbf1a-2b9e-460a-91e9-e6c4393dbc4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8cdfa-9d32-430b-9dba-5315ac4c373e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a048bb21-783e-42d1-8c46-e4e8f702b12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:02:24 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:02:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[66513b2e-11e8-4956-9041-9a5c03d044c3]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG os_brick.utils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:02:24 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updating existing volume attachment record: 1f783f04-b40f-4a8f-ab26-6aaa3195dd9a {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:02:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Successfully created port: e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Successfully updated port: e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-changed-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Refreshing instance network info cache due to event network-changed-e386a95d-8e3e-40d7-a44a-ddebbb661912. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] Acquiring lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updating instance_info_cache with network_info: [{"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Instance network_info: |[{"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] Acquired lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Refreshing network info cache for port e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:02:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:27 user nova-compute[73110]: DEBUG nova.network.neutron [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updated VIF entry in instance network info cache for port e386a95d-8e3e-40d7-a44a-ddebbb661912. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:02:27 user nova-compute[73110]: DEBUG nova.network.neutron [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updating instance_info_cache with network_info: [{"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-40260374-6c77-45f4-909a-90764504e266 req-77bf895c-6907-4e6d-a9af-a26e1050758e service nova] Releasing lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:29 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693072934.6856272, 7af95a7a-596c-4a04-b178-870d8ca535f5 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:29 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] VM Stopped (Lifecycle Event)
Aug 26 18:02:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-411b9bf9-5ee6-4ee7-8eaf-dceecee30002 None None] [instance: 7af95a7a-596c-4a04-b178-870d8ca535f5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:33 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:02:33 user nova-compute[73110]: INFO nova.compute.claims [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Claim successful on node user
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:02:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.policy [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ac81964ee54d3296747f0a389aeacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91abd0a8954494b86983642950796fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:02:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Creating image(s)
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "/opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "/opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "/opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.224s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk 1073741824" returned: 0 in 0.075s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Successfully created port: f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Cannot resize image /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Ensure instance console log exists: /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Successfully updated port: f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquired lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-changed-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Refreshing instance network info cache due to event network-changed-f538e59c-27ee-4d26-8552-37085b5df9a5. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] Acquiring lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Updating instance_info_cache with network_info: [{"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Releasing lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Instance network_info: |[{"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] Acquired lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Refreshing network info cache for port f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Start _get_guest_xml network_info=[{"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:02:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806554356',display_name='tempest-VolumesActionsTest-instance-806554356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806554356',id=40,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-ki0yk054',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:34Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=d366204d-db04-4f07-8dfc-08dd5509e3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lazy-loading 'pci_devices' on Instance uuid d366204d-db04-4f07-8dfc-08dd5509e3d9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:02:36 user nova-compute[73110]:   <uuid>d366204d-db04-4f07-8dfc-08dd5509e3d9</uuid>
Aug 26 18:02:36 user nova-compute[73110]:   <name>instance-00000028</name>
Aug 26 18:02:36 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:02:36 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:02:36 user nova-compute[73110]:   <metadata>
Aug 26 18:02:36 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:02:36 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:name>tempest-VolumesActionsTest-instance-806554356</nova:name>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:02:36</nova:creationTime>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:02:36 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:02:36 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:owner>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:user uuid="64ac81964ee54d3296747f0a389aeacf">tempest-VolumesActionsTest-38073166-project-member</nova:user>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:project uuid="f91abd0a8954494b86983642950796fd">tempest-VolumesActionsTest-38073166</nova:project>
Aug 26 18:02:36 user nova-compute[73110]:       </nova:owner>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:02:36 user nova-compute[73110]:       <nova:ports>
Aug 26 18:02:36 user nova-compute[73110]:         <nova:port uuid="f538e59c-27ee-4d26-8552-37085b5df9a5">
Aug 26 18:02:36 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 18:02:36 user nova-compute[73110]:         </nova:port>
Aug 26 18:02:36 user nova-compute[73110]:       </nova:ports>
Aug 26 18:02:36 user nova-compute[73110]:     </nova:instance>
Aug 26 18:02:36 user nova-compute[73110]:   </metadata>
Aug 26 18:02:36 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:02:36 user nova-compute[73110]:     <system>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="serial">d366204d-db04-4f07-8dfc-08dd5509e3d9</entry>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="uuid">d366204d-db04-4f07-8dfc-08dd5509e3d9</entry>
Aug 26 18:02:36 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:02:36 user nova-compute[73110]:     </system>
Aug 26 18:02:36 user nova-compute[73110]:   </sysinfo>
Aug 26 18:02:36 user nova-compute[73110]:   <os>
Aug 26 18:02:36 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:02:36 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:02:36 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:02:36 user nova-compute[73110]:   </os>
Aug 26 18:02:36 user nova-compute[73110]:   <features>
Aug 26 18:02:36 user nova-compute[73110]:     <acpi/>
Aug 26 18:02:36 user nova-compute[73110]:     <apic/>
Aug 26 18:02:36 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:02:36 user nova-compute[73110]:   </features>
Aug 26 18:02:36 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:02:36 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:02:36 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:02:36 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:02:36 user nova-compute[73110]:   </clock>
Aug 26 18:02:36 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:02:36 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:02:36 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:02:36 user nova-compute[73110]:   </cpu>
Aug 26 18:02:36 user nova-compute[73110]:   <devices>
Aug 26 18:02:36 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:02:36 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:02:36 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk"/>
Aug 26 18:02:36 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:02:36 user nova-compute[73110]:     </disk>
Aug 26 18:02:36 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:02:36 user nova-compute[73110]:       <mac address="fa:16:3e:66:4a:dd"/>
Aug 26 18:02:36 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:36 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:02:36 user nova-compute[73110]:       <target dev="tapf538e59c-27"/>
Aug 26 18:02:36 user nova-compute[73110]:     </interface>
Aug 26 18:02:36 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:02:36 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/console.log" append="off"/>
Aug 26 18:02:36 user nova-compute[73110]:     </serial>
Aug 26 18:02:36 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:02:36 user nova-compute[73110]:     <video>
Aug 26 18:02:36 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:36 user nova-compute[73110]:     </video>
Aug 26 18:02:36 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:02:36 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:02:36 user nova-compute[73110]:     </rng>
Aug 26 18:02:36 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:02:36 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:02:36 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:02:36 user nova-compute[73110]:     </memballoon>
Aug 26 18:02:36 user nova-compute[73110]:   </devices>
Aug 26 18:02:36 user nova-compute[73110]: </domain>
Aug 26 18:02:36 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806554356',display_name='tempest-VolumesActionsTest-instance-806554356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806554356',id=40,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-ki0yk054',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:34Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=d366204d-db04-4f07-8dfc-08dd5509e3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_vif [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf538e59c-27, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf538e59c-27, col_values=(('external_ids', {'iface-id': 'f538e59c-27ee-4d26-8552-37085b5df9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:4a:dd', 'vm-uuid': 'd366204d-db04-4f07-8dfc-08dd5509e3d9'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:36 user nova-compute[73110]: INFO os_vif [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27')
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] No VIF found with MAC fa:16:3e:66:4a:dd, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Updated VIF entry in instance network info cache for port f538e59c-27ee-4d26-8552-37085b5df9a5. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Updating instance_info_cache with network_info: [{"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:02:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Creating image(s)
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Ensure instance console log exists: /opt/stack/data/nova/instances/512050ec-35e7-4bfa-8919-011f856986f4/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Start _get_guest_xml network_info=[{"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1f783f04-b40f-4a8f-ab26-6aaa3195dd9a', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAWJZNfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '512050ec-35e7-4bfa-8919-011f856986f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb815c35-b127-47ed-b95b-4122f84a17c7', 'serial': 'eb815c35-b127-47ed-b95b-4122f84a17c7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c78ee68-9fdb-4e41-bfb2-6dab5501044e req-8767e7a7-fb15-457c-8498-682539a662d5 service nova] Releasing lock "refresh_cache-d366204d-db04-4f07-8dfc-08dd5509e3d9" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAWJZNfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:02:36 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:02:36 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:02:36 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f9da5d-ba94-4372-a465-e6083728b6d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:02:36 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[764336be-0310-42b9-8fa1-dae0e7e4bf17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7] added
Aug 26 18:02:36 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cea43d-7141-476d-8c4b-b965f529d643]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a381dc9d-5e0d-4f5f-af01-e7486d2b79b7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAWJZNfc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAWJZNfc" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8f33d-b443-45ac-a934-4f222f801256]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EAWJZNfc'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfffb4d-069c-48fe-a7b3-b931a1cfb71d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9a60f-6a5f-4e19-a709-d9d0cfd17ddb]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:36 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:36 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:36 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:36 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:36 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:36 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:02:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc035c-d7ad-495d-804a-cab61821d96d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260]
Aug 26 18:02:37 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:02:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[766738e7-0ef6-40aa-9cec-2bb437c9c8be]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1062bf07-51e2-4604-aad9-bcaf051b92d3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:02:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ca543-a8ca-4765-a57a-7c778e7618c2]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAWJZNfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] No waiting events found dispatching network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:37 user nova-compute[73110]: WARNING nova.compute.manager [req-6690ec2a-1f9b-4a76-9553-1b1999b4cafb req-aa3015ba-638d-4cb9-afda-1118ca63e3b3 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received unexpected event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 for instance with vm_state building and task_state spawning.
Aug 26 18:02:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26266353064653862', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266353064653862', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133146417',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ1EMNzTSB/d9C3QgjxZ8AAl05FUKEdieNyxMR8hjJWf5fzVYVltP1OAgrdNZqNjCOjEJIgXDCFrUCbMF9EmAMrlgHHQv5ffXWeP3Ap647LAqq+nsOh36P7+iM7xxb7Kg==',key_name='tempest-keypair-853239979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-wjx8ir2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=512050ec-35e7-4bfa-8919-011f856986f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.objects.instance [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid 512050ec-35e7-4bfa-8919-011f856986f4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:02:38 user nova-compute[73110]:   <uuid>512050ec-35e7-4bfa-8919-011f856986f4</uuid>
Aug 26 18:02:38 user nova-compute[73110]:   <name>instance-00000027</name>
Aug 26 18:02:38 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:02:38 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:02:38 user nova-compute[73110]:   <metadata>
Aug 26 18:02:38 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:02:38 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:02:38 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1133146417</nova:name>
Aug 26 18:02:38 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:02:36</nova:creationTime>
Aug 26 18:02:38 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:02:38 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:02:38 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:02:38 user nova-compute[73110]:       <nova:owner>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 18:02:38 user nova-compute[73110]:       </nova:owner>
Aug 26 18:02:38 user nova-compute[73110]:       <nova:ports>
Aug 26 18:02:38 user nova-compute[73110]:         <nova:port uuid="e386a95d-8e3e-40d7-a44a-ddebbb661912">
Aug 26 18:02:38 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 18:02:38 user nova-compute[73110]:         </nova:port>
Aug 26 18:02:38 user nova-compute[73110]:       </nova:ports>
Aug 26 18:02:38 user nova-compute[73110]:     </nova:instance>
Aug 26 18:02:38 user nova-compute[73110]:   </metadata>
Aug 26 18:02:38 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:02:38 user nova-compute[73110]:     <system>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="serial">512050ec-35e7-4bfa-8919-011f856986f4</entry>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="uuid">512050ec-35e7-4bfa-8919-011f856986f4</entry>
Aug 26 18:02:38 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:02:38 user nova-compute[73110]:     </system>
Aug 26 18:02:38 user nova-compute[73110]:   </sysinfo>
Aug 26 18:02:38 user nova-compute[73110]:   <os>
Aug 26 18:02:38 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:02:38 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:02:38 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:02:38 user nova-compute[73110]:   </os>
Aug 26 18:02:38 user nova-compute[73110]:   <features>
Aug 26 18:02:38 user nova-compute[73110]:     <acpi/>
Aug 26 18:02:38 user nova-compute[73110]:     <apic/>
Aug 26 18:02:38 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:02:38 user nova-compute[73110]:   </features>
Aug 26 18:02:38 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:02:38 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:02:38 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:02:38 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:02:38 user nova-compute[73110]:   </clock>
Aug 26 18:02:38 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:02:38 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:02:38 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:02:38 user nova-compute[73110]:   </cpu>
Aug 26 18:02:38 user nova-compute[73110]:   <devices>
Aug 26 18:02:38 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:02:38 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:02:38 user nova-compute[73110]:       <source dev="/dev/sde"/>
Aug 26 18:02:38 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:02:38 user nova-compute[73110]:       <serial>eb815c35-b127-47ed-b95b-4122f84a17c7</serial>
Aug 26 18:02:38 user nova-compute[73110]:     </disk>
Aug 26 18:02:38 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:02:38 user nova-compute[73110]:       <mac address="fa:16:3e:17:23:fa"/>
Aug 26 18:02:38 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:38 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:02:38 user nova-compute[73110]:       <target dev="tape386a95d-8e"/>
Aug 26 18:02:38 user nova-compute[73110]:     </interface>
Aug 26 18:02:38 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:02:38 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/512050ec-35e7-4bfa-8919-011f856986f4/console.log" append="off"/>
Aug 26 18:02:38 user nova-compute[73110]:     </serial>
Aug 26 18:02:38 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:02:38 user nova-compute[73110]:     <video>
Aug 26 18:02:38 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:38 user nova-compute[73110]:     </video>
Aug 26 18:02:38 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:02:38 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:02:38 user nova-compute[73110]:     </rng>
Aug 26 18:02:38 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:02:38 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:02:38 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:02:38 user nova-compute[73110]:     </memballoon>
Aug 26 18:02:38 user nova-compute[73110]:   </devices>
Aug 26 18:02:38 user nova-compute[73110]: </domain>
Aug 26 18:02:38 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133146417',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ1EMNzTSB/d9C3QgjxZ8AAl05FUKEdieNyxMR8hjJWf5fzVYVltP1OAgrdNZqNjCOjEJIgXDCFrUCbMF9EmAMrlgHHQv5ffXWeP3Ap647LAqq+nsOh36P7+iM7xxb7Kg==',key_name='tempest-keypair-853239979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-wjx8ir2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=512050ec-35e7-4bfa-8919-011f856986f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG os_vif [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape386a95d-8e, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape386a95d-8e, col_values=(('external_ids', {'iface-id': 'e386a95d-8e3e-40d7-a44a-ddebbb661912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:23:fa', 'vm-uuid': '512050ec-35e7-4bfa-8919-011f856986f4'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: INFO os_vif [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e')
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:17:23:fa, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072960.06942, d366204d-db04-4f07-8dfc-08dd5509e3d9 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] VM Resumed (Lifecycle Event)
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Instance spawned successfully.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072960.0707572, d366204d-db04-4f07-8dfc-08dd5509e3d9 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] VM Started (Lifecycle Event)
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:40 user nova-compute[73110]: INFO nova.compute.manager [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Took 6.60 seconds to build instance.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7256bb33-851f-425e-b8e1-c1efd971ce14 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.729s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] No waiting events found dispatching network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:40 user nova-compute[73110]: WARNING nova.compute.manager [req-700e5091-85af-4592-a78e-f4cd1180ad19 req-34610216-3591-4189-9240-487589499847 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received unexpected event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 for instance with vm_state active and task_state None.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] No waiting events found dispatching network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:40 user nova-compute[73110]: WARNING nova.compute.manager [req-e402d49c-4bd8-40b8-a255-bf9e3fbf0f73 req-79bcf224-f8ad-4fca-81da-d97423399383 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received unexpected event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 for instance with vm_state building and task_state spawning.
Aug 26 18:02:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072961.8810492, 512050ec-35e7-4bfa-8919-011f856986f4 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:41 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] VM Resumed (Lifecycle Event)
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:02:41 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Instance spawned successfully.
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:41 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072961.8813891, 512050ec-35e7-4bfa-8919-011f856986f4 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:41 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] VM Started (Lifecycle Event)
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:41 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:41 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:42 user nova-compute[73110]: INFO nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 26 18:02:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:42 user nova-compute[73110]: INFO nova.compute.manager [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Took 18.14 seconds to build instance.
Aug 26 18:02:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-45edc1d2-35fc-4060-9c43-94d152f8f766 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.237s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] No waiting events found dispatching network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:42 user nova-compute[73110]: WARNING nova.compute.manager [req-1b555e71-4a77-4833-9d2e-2441d57baaeb req-5d5060e9-2ba6-462a-873d-f8511f7591d7 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received unexpected event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 for instance with vm_state active and task_state None.
Aug 26 18:02:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:44 user nova-compute[73110]: INFO nova.compute.manager [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Rescuing
Aug 26 18:02:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:44 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:02:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:45 user nova-compute[73110]: DEBUG nova.network.neutron [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG nova.compute.manager [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:46 user nova-compute[73110]: WARNING nova.compute.manager [req-6b7af3da-5cb2-4cb9-b6bf-7a1c8b3d2c47 req-7da5bb1d-1700-446b-b686-e80f6ae00161 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state active and task_state rescuing.
Aug 26 18:02:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance destroyed successfully.
Aug 26 18:02:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Attempting a stable device rescue
Aug 26 18:02:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73110) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance directory exists: not creating {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 18:02:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Creating image(s)
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:47 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.images [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] 3bb65aad-1900-407a-b3e1-8fee4552bcd5 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.part /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.part /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.converted" returned: 0 in 0.352s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.compute.manager [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:48 user nova-compute[73110]: WARNING nova.compute.manager [req-2559374c-fd9d-480e-adad-75029122736d req-f90d0295-d019-4a26-ba09-1995bbd3052d service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state active and task_state rescuing.
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.947s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42 --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42,backing_fmt=raw /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42,backing_fmt=raw /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue" returned: 0 in 0.054s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "7f34c8f2d2edad21b469dd1a1898afe016777a42" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'migration_context' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<e6aca42c-964c-4f78-b4c7-84457922c215> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start _get_guest_xml network_info=[{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:26:c2:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3bb65aad-1900-407a-b3e1-8fee4552bcd5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f047010a-4a8d-49c6-b2a6-9494af789515', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e6aca42c-964c-4f78-b4c7-84457922c215', 'attached_at': '', 'detached_at': '', 'volume_id': '6097158a-f767-4531-a6d4-d7ddfcd41c79', 'serial': '6097158a-f767-4531-a6d4-d7ddfcd41c79'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<e6aca42c-964c-4f78-b4c7-84457922c215> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'numa_topology' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<e6aca42c-964c-4f78-b4c7-84457922c215> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:02:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:48 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.objects.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<e6aca42c-964c-4f78-b4c7-84457922c215> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:02:48 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:02:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:02:48 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:02:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:02:48 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:02:48 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:02:48 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33065c4-5ba6-4cba-98ac-e8e7679fd2a1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bqgLptKN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 18:02:49 user nova-compute[73110]: node.name = iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79
Aug 26 18:02:49 user nova-compute[73110]: node.tpgt = -1
Aug 26 18:02:49 user nova-compute[73110]: node.startup = automatic
Aug 26 18:02:49 user nova-compute[73110]: node.leading_login = No
Aug 26 18:02:49 user nova-compute[73110]: iface.iscsi_ifacename = default
Aug 26 18:02:49 user nova-compute[73110]: iface.net_ifacename = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.ipaddress = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.prefix_len = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.hwaddress = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.transport_name = tcp
Aug 26 18:02:49 user nova-compute[73110]: iface.initiatorname = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.vlan_id = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.vlan_priority = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.vlan_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.iface_num = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.mtu = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.port = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.bootproto = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.subnet_mask = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.gateway = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_alt_client_id = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_dns = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_learn_iqn = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_vendor_id_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_vendor_id = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.dhcp_slp_da = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.fragmentation = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.gratuitous_arp = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.incoming_forwarding = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.tos_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.tos = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.ttl = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.delayed_ack = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.tcp_nagle = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.tcp_wsf_state = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.tcp_wsf = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.tcp_timer_scale = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.tcp_timestamp = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.redirect = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.def_task_mgmt_timeout = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.header_digest = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.data_digest = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.immediate_data = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.initial_r2t = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.data_seq_inorder = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.data_pdu_inorder = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.erl = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.max_receive_data_len = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.first_burst_len = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.max_outstanding_r2t = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.max_burst_len = 0
Aug 26 18:02:49 user nova-compute[73110]: iface.chap_auth = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.bidi_chap = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.strict_login_compliance = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.discovery_auth = <empty>
Aug 26 18:02:49 user nova-compute[73110]: iface.discovery_logout = <empty>
Aug 26 18:02:49 user nova-compute[73110]: node.discovery_address = <empty>
Aug 26 18:02:49 user nova-compute[73110]: node.discovery_port = 0
Aug 26 18:02:49 user nova-compute[73110]: node.discovery_type = static
Aug 26 18:02:49 user nova-compute[73110]: node.session.initial_cmdsn = 0
Aug 26 18:02:49 user nova-compute[73110]: node.session.initial_login_retry_max = 8
Aug 26 18:02:49 user nova-compute[73110]: node.session.xmit_thread_priority = -20
Aug 26 18:02:49 user nova-compute[73110]: node.session.cmds_max = 128
Aug 26 18:02:49 user nova-compute[73110]: node.session.queue_depth = 32
Aug 26 18:02:49 user nova-compute[73110]: node.session.nr_sessions = 1
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.authmethod = CHAP
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.username = bqgLptKN
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.password = ***
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.username_in = <empty>
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.password_in = <empty>
Aug 26 18:02:49 user nova-compute[73110]: node.session.auth.chap_algs = MD5
Aug 26 18:02:49 user nova-compute[73110]: node.session.timeo.replacement_timeout = 120
Aug 26 18:02:49 user nova-compute[73110]: node.session.err_timeo.abort_timeout = 15
Aug 26 18:02:49 user nova-compute[73110]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 18:02:49 user nova-compute[73110]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 18:02:49 user nova-compute[73110]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.FastAbort = Yes
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.InitialR2T = No
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.ImmediateData = Yes
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.MaxConnections = 1
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 18:02:49 user nova-compute[73110]: node.session.iscsi.ERL = 0
Aug 26 18:02:49 user nova-compute[73110]: node.session.scan = manual
Aug 26 18:02:49 user nova-compute[73110]: node.session.reopen_max = 0
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].address = 172.16.0.220
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].port = 3260
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].startup = manual
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].tcp.window_size = 524288
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].tcp.type_of_service = 0
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].timeo.logout_timeout = 15
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].timeo.login_timeout = 15
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].timeo.auth_timeout = 45
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.DataDigest = None
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.IFMarker = No
Aug 26 18:02:49 user nova-compute[73110]: node.conn[0].iscsi.OFMarker = No
Aug 26 18:02:49 user nova-compute[73110]: # END RECORD
Aug 26 18:02:49 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17155d66-10c6-40c3-a6b0-1802a120c43b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a051c-3119-4fd0-8de7-28a9f9de4dd5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqgLptKN {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqgLptKN" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9facae1e-011e-42b0-808f-677cbdb1bd63]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqgLptKN'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6a03c9-3407-4489-870e-59ca999af99e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77b08c4-287d-4300-93d9-b70cc1411bda]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:02:49 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] HCTL ('34', '0', '0', 0) found on session 48 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f22eca0-ba07-417e-8d3e-29bdf40af6f9]: (4, ('0 0 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Searching for a device in session 48 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '26266666634326235', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266666634326235', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1630820214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1630820214',id=38,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-0bghsrgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:01:38Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=e6aca42c-964c-4f78-b4c7-84457922c215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:26:c2:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "vif_mac": "fa:16:3e:26:c2:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'pci_devices' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.objects.base [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Object Instance<e6aca42c-964c-4f78-b4c7-84457922c215> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:02:49 user nova-compute[73110]:   <uuid>e6aca42c-964c-4f78-b4c7-84457922c215</uuid>
Aug 26 18:02:49 user nova-compute[73110]:   <name>instance-00000026</name>
Aug 26 18:02:49 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:02:49 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:02:49 user nova-compute[73110]:   <metadata>
Aug 26 18:02:49 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:02:49 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1630820214</nova:name>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:02:48</nova:creationTime>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:02:49 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:02:49 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:owner>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:user uuid="095465fef30b4fd0a144cb5b7c4ffb7d">tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member</nova:user>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:project uuid="8ef6ddc676bd48e4886079097e3e0d7a">tempest-ServerBootFromVolumeStableRescueTest-1304505303</nova:project>
Aug 26 18:02:49 user nova-compute[73110]:       </nova:owner>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:02:49 user nova-compute[73110]:       <nova:ports>
Aug 26 18:02:49 user nova-compute[73110]:         <nova:port uuid="363252b1-b8e9-4647-82d5-b112af68533d">
Aug 26 18:02:49 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 18:02:49 user nova-compute[73110]:         </nova:port>
Aug 26 18:02:49 user nova-compute[73110]:       </nova:ports>
Aug 26 18:02:49 user nova-compute[73110]:     </nova:instance>
Aug 26 18:02:49 user nova-compute[73110]:   </metadata>
Aug 26 18:02:49 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:02:49 user nova-compute[73110]:     <system>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="serial">e6aca42c-964c-4f78-b4c7-84457922c215</entry>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="uuid">e6aca42c-964c-4f78-b4c7-84457922c215</entry>
Aug 26 18:02:49 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:02:49 user nova-compute[73110]:     </system>
Aug 26 18:02:49 user nova-compute[73110]:   </sysinfo>
Aug 26 18:02:49 user nova-compute[73110]:   <os>
Aug 26 18:02:49 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:02:49 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:02:49 user nova-compute[73110]:   </os>
Aug 26 18:02:49 user nova-compute[73110]:   <features>
Aug 26 18:02:49 user nova-compute[73110]:     <acpi/>
Aug 26 18:02:49 user nova-compute[73110]:     <apic/>
Aug 26 18:02:49 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:02:49 user nova-compute[73110]:   </features>
Aug 26 18:02:49 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:02:49 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:02:49 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:02:49 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:02:49 user nova-compute[73110]:   </clock>
Aug 26 18:02:49 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:02:49 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:02:49 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:02:49 user nova-compute[73110]:   </cpu>
Aug 26 18:02:49 user nova-compute[73110]:   <devices>
Aug 26 18:02:49 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:02:49 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:02:49 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 18:02:49 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:02:49 user nova-compute[73110]:       <serial>6097158a-f767-4531-a6d4-d7ddfcd41c79</serial>
Aug 26 18:02:49 user nova-compute[73110]:     </disk>
Aug 26 18:02:49 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:02:49 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:02:49 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue"/>
Aug 26 18:02:49 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 18:02:49 user nova-compute[73110]:       <boot order="1"/>
Aug 26 18:02:49 user nova-compute[73110]:     </disk>
Aug 26 18:02:49 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:02:49 user nova-compute[73110]:       <mac address="fa:16:3e:26:c2:4b"/>
Aug 26 18:02:49 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:49 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:02:49 user nova-compute[73110]:       <target dev="tap363252b1-b8"/>
Aug 26 18:02:49 user nova-compute[73110]:     </interface>
Aug 26 18:02:49 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:02:49 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/console.log" append="off"/>
Aug 26 18:02:49 user nova-compute[73110]:     </serial>
Aug 26 18:02:49 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:02:49 user nova-compute[73110]:     <video>
Aug 26 18:02:49 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:49 user nova-compute[73110]:     </video>
Aug 26 18:02:49 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:02:49 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:02:49 user nova-compute[73110]:     </rng>
Aug 26 18:02:49 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:02:49 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:02:49 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:02:49 user nova-compute[73110]:     </memballoon>
Aug 26 18:02:49 user nova-compute[73110]:   </devices>
Aug 26 18:02:49 user nova-compute[73110]: </domain>
Aug 26 18:02:49 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:02:49 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance destroyed successfully.
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] No VIF found with MAC fa:16:3e:26:c2:4b, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:02:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:52 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:02:52 user nova-compute[73110]: INFO nova.compute.claims [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Claim successful on node user
Aug 26 18:02:52 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:02:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for e6aca42c-964c-4f78-b4c7-84457922c215 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072973.1245534, e6aca42c-964c-4f78-b4c7-84457922c215 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Resumed (Lifecycle Event)
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f6e0daaa-7f53-45db-95d7-f8bd79edf155 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.policy [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e166fb79ac46669ca6580d0bb1b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205df4d98cf24ae48843664efb353420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072973.1373367, e6aca42c-964c-4f78-b4c7-84457922c215 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:53 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Started (Lifecycle Event)
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:02:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Creating image(s)
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "/opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "/opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:53 user nova-compute[73110]: WARNING nova.compute.manager [req-ecf4bdb6-e4d4-42b6-838a-ecbe883ce908 req-f35ec836-89b2-4f16-b7f4-97322763b0d0 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state rescued and task_state None.
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk 1073741824" returned: 0 in 0.062s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Successfully created port: 419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Cannot resize image /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Ensure instance console log exists: /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Successfully updated port: 419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing instance network info cache due to event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.neutron [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Instance network_info: |[{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Start _get_guest_xml network_info=[{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:02:55 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:55 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-717098164',display_name='tempest-TestStampPattern-server-717098164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-717098164',id=41,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-asl1is5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:53Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=1d17f7fc-88c5-4270-9249-52dbe3d9354a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.objects.instance [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:02:55 user nova-compute[73110]:   <uuid>1d17f7fc-88c5-4270-9249-52dbe3d9354a</uuid>
Aug 26 18:02:55 user nova-compute[73110]:   <name>instance-00000029</name>
Aug 26 18:02:55 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:02:55 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:02:55 user nova-compute[73110]:   <metadata>
Aug 26 18:02:55 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:02:55 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:name>tempest-TestStampPattern-server-717098164</nova:name>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:02:55</nova:creationTime>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:02:55 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:02:55 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:owner>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:user uuid="62e166fb79ac46669ca6580d0bb1b6eb">tempest-TestStampPattern-277351961-project-member</nova:user>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:project uuid="205df4d98cf24ae48843664efb353420">tempest-TestStampPattern-277351961</nova:project>
Aug 26 18:02:55 user nova-compute[73110]:       </nova:owner>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:02:55 user nova-compute[73110]:       <nova:ports>
Aug 26 18:02:55 user nova-compute[73110]:         <nova:port uuid="419ace13-8fdb-4f3e-a89b-689457696e88">
Aug 26 18:02:55 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 18:02:55 user nova-compute[73110]:         </nova:port>
Aug 26 18:02:55 user nova-compute[73110]:       </nova:ports>
Aug 26 18:02:55 user nova-compute[73110]:     </nova:instance>
Aug 26 18:02:55 user nova-compute[73110]:   </metadata>
Aug 26 18:02:55 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:02:55 user nova-compute[73110]:     <system>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="serial">1d17f7fc-88c5-4270-9249-52dbe3d9354a</entry>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="uuid">1d17f7fc-88c5-4270-9249-52dbe3d9354a</entry>
Aug 26 18:02:55 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:02:55 user nova-compute[73110]:     </system>
Aug 26 18:02:55 user nova-compute[73110]:   </sysinfo>
Aug 26 18:02:55 user nova-compute[73110]:   <os>
Aug 26 18:02:55 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:02:55 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:02:55 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:02:55 user nova-compute[73110]:   </os>
Aug 26 18:02:55 user nova-compute[73110]:   <features>
Aug 26 18:02:55 user nova-compute[73110]:     <acpi/>
Aug 26 18:02:55 user nova-compute[73110]:     <apic/>
Aug 26 18:02:55 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:02:55 user nova-compute[73110]:   </features>
Aug 26 18:02:55 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:02:55 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:02:55 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:02:55 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:02:55 user nova-compute[73110]:   </clock>
Aug 26 18:02:55 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:02:55 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:02:55 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:02:55 user nova-compute[73110]:   </cpu>
Aug 26 18:02:55 user nova-compute[73110]:   <devices>
Aug 26 18:02:55 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:02:55 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:02:55 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk"/>
Aug 26 18:02:55 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:02:55 user nova-compute[73110]:     </disk>
Aug 26 18:02:55 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:02:55 user nova-compute[73110]:       <mac address="fa:16:3e:11:9a:f6"/>
Aug 26 18:02:55 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:55 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:02:55 user nova-compute[73110]:       <target dev="tap419ace13-8f"/>
Aug 26 18:02:55 user nova-compute[73110]:     </interface>
Aug 26 18:02:55 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:02:55 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/console.log" append="off"/>
Aug 26 18:02:55 user nova-compute[73110]:     </serial>
Aug 26 18:02:55 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:02:55 user nova-compute[73110]:     <video>
Aug 26 18:02:55 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:02:55 user nova-compute[73110]:     </video>
Aug 26 18:02:55 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:02:55 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:02:55 user nova-compute[73110]:     </rng>
Aug 26 18:02:55 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:02:55 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:02:55 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:02:55 user nova-compute[73110]:     </memballoon>
Aug 26 18:02:55 user nova-compute[73110]:   </devices>
Aug 26 18:02:55 user nova-compute[73110]: </domain>
Aug 26 18:02:55 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-717098164',display_name='tempest-TestStampPattern-server-717098164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-717098164',id=41,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-asl1is5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:02:53Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=1d17f7fc-88c5-4270-9249-52dbe3d9354a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG os_vif [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419ace13-8f, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap419ace13-8f, col_values=(('external_ids', {'iface-id': '419ace13-8fdb-4f3e-a89b-689457696e88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9a:f6', 'vm-uuid': '1d17f7fc-88c5-4270-9249-52dbe3d9354a'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:55 user nova-compute[73110]: INFO os_vif [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f')
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No VIF found with MAC fa:16:3e:11:9a:f6, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:55 user nova-compute[73110]: WARNING nova.compute.manager [req-ca1b5c68-a848-4935-ba89-744afb77b0d1 req-7baca115-dcd6-4b84-b2c0-1dedd16ae680 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state rescued and task_state None.
Aug 26 18:02:56 user nova-compute[73110]: DEBUG nova.network.neutron [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updated VIF entry in instance network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:02:56 user nova-compute[73110]: DEBUG nova.network.neutron [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:02:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-461357f4-785e-4c0f-8696-f18d6b37b49f req-a5842911-0d68-4592-8fff-85dc0026e312 service nova] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG nova.compute.manager [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] No waiting events found dispatching network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:57 user nova-compute[73110]: WARNING nova.compute.manager [req-2cdc12ba-736e-4c94-a465-c6e56add51bf req-f6df558a-83be-4d4b-a630-fa52aa7593bd service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received unexpected event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 for instance with vm_state building and task_state spawning.
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072979.4327285, 1d17f7fc-88c5-4270-9249-52dbe3d9354a => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] VM Resumed (Lifecycle Event)
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Instance spawned successfully.
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072979.4340053, 1d17f7fc-88c5-4270-9249-52dbe3d9354a => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] VM Started (Lifecycle Event)
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] No waiting events found dispatching network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:02:59 user nova-compute[73110]: WARNING nova.compute.manager [req-33aec7a6-89ad-490c-b032-c4b9c2073d3b req-1af1afbc-1316-4075-9cc5-15d8de8ec15c service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received unexpected event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 for instance with vm_state building and task_state spawning.
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 26 18:02:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:02:59 user nova-compute[73110]: INFO nova.compute.manager [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Took 7.10 seconds to build instance.
Aug 26 18:02:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-735d6228-f76e-48df-9e12-b0e1f2eef802 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.229s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:02:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:02 user nova-compute[73110]: INFO nova.compute.manager [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Unrescuing
Aug 26 18:03:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:03:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:03:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'flavor' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:03:04 user nova-compute[73110]: WARNING nova.compute.manager [req-56d4b48b-3cb2-479d-98d9-8f8d91f107cf req-20d52313-5072-4ccf-bd39-2e434a2becfd service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:03:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:04 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance destroyed successfully.
Aug 26 18:03:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:03:06 user nova-compute[73110]: WARNING nova.compute.manager [req-ebd308d6-33b9-437d-a8b4-dde1eaf961d8 req-52cd4e73-e1a0-44ab-9b7a-c546cea93e17 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:03:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:03:08 user nova-compute[73110]: WARNING nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:03:08 user nova-compute[73110]: WARNING nova.compute.manager [req-b8d61f18-4560-4a9f-830a-b8ad51bb2cb2 req-b1a2f728-ba22-40fd-80a1-edfc1ea32304 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 158e68cf-4eba-4b8b-956c-4eeff158119b due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072988.7281249, 158e68cf-4eba-4b8b-956c-4eeff158119b => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:03:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Resumed (Lifecycle Event)
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-46df3e86-0265-46f9-8c65-7b4a1f6b8e52 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:03:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693072988.7293015, 158e68cf-4eba-4b8b-956c-4eeff158119b => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:03:08 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Started (Lifecycle Event)
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:03:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:03:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [{"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-573d5b76-ace4-471a-a1d4-5a770389d14f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:03:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:03:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:03:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:03:17 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:03:17 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=24.972801208496094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 512050ec-35e7-4bfa-8919-011f856986f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d366204d-db04-4f07-8dfc-08dd5509e3d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:03:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:03:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:03:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:03:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:03:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:04:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:04:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:04:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-changed-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Refreshing instance network info cache due to event network-changed-e386a95d-8e3e-40d7-a44a-ddebbb661912. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] Acquiring lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] Acquired lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Refreshing network info cache for port e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [{"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-524fef5b-abfb-4d7d-b14f-eb899fa526d2" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updated VIF entry in instance network info cache for port e386a95d-8e3e-40d7-a44a-ddebbb661912. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updating instance_info_cache with network_info: [{"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6192baa3-8478-4473-bcc9-b66a854bd3b9 req-49280a6d-f1ea-49b3-89ce-24ce53e65d74 service nova] Releasing lock "refresh_cache-512050ec-35e7-4bfa-8919-011f856986f4" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:04:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:04:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=24.942142486572266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 512050ec-35e7-4bfa-8919-011f856986f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d366204d-db04-4f07-8dfc-08dd5509e3d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:04:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:04:20 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:04:20 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:04:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:04:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:24 user nova-compute[73110]: INFO nova.compute.manager [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Terminating instance
Aug 26 18:04:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-unplugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] No waiting events found dispatching network-vif-unplugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-6f37be08-7f22-4a80-94d8-ffe8ee3e02a6 req-3fbabe0b-f3b8-48c2-84d0-861540f00e7f service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-unplugged-f538e59c-27ee-4d26-8552-37085b5df9a5 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:04:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Instance destroyed successfully.
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lazy-loading 'resources' on Instance uuid d366204d-db04-4f07-8dfc-08dd5509e3d9 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806554356',display_name='tempest-VolumesActionsTest-instance-806554356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806554356',id=40,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:02:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-ki0yk054',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:02:40Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=d366204d-db04-4f07-8dfc-08dd5509e3d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "f538e59c-27ee-4d26-8552-37085b5df9a5", "address": "fa:16:3e:66:4a:dd", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf538e59c-27", "ovs_interfaceid": "f538e59c-27ee-4d26-8552-37085b5df9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG os_vif [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf538e59c-27, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:04:25 user nova-compute[73110]: INFO os_vif [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=f538e59c-27ee-4d26-8552-37085b5df9a5,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf538e59c-27')
Aug 26 18:04:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Deleting instance files /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9_del
Aug 26 18:04:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Deletion of /opt/stack/data/nova/instances/d366204d-db04-4f07-8dfc-08dd5509e3d9_del complete
Aug 26 18:04:25 user nova-compute[73110]: INFO nova.compute.manager [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 18:04:25 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:04:25 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:26 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Took 0.68 seconds to deallocate network for instance.
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-789f5dbd-b14a-4ec1-92f8-52bed3068680 req-13b7c0a5-4874-4131-b068-54e3e792b698 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-deleted-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:26 user nova-compute[73110]: INFO nova.compute.manager [req-789f5dbd-b14a-4ec1-92f8-52bed3068680 req-13b7c0a5-4874-4131-b068-54e3e792b698 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Neutron deleted interface f538e59c-27ee-4d26-8552-37085b5df9a5; detaching it from the instance and deleting it from the info cache
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-789f5dbd-b14a-4ec1-92f8-52bed3068680 req-13b7c0a5-4874-4131-b068-54e3e792b698 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-789f5dbd-b14a-4ec1-92f8-52bed3068680 req-13b7c0a5-4874-4131-b068-54e3e792b698 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Detach interface failed, port_id=f538e59c-27ee-4d26-8552-37085b5df9a5, reason: Instance d366204d-db04-4f07-8dfc-08dd5509e3d9 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:26 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Deleted allocations for instance d366204d-db04-4f07-8dfc-08dd5509e3d9
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5c7475a6-5881-4d56-9afb-8a91a4cf72be tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] Acquiring lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] Lock "d366204d-db04-4f07-8dfc-08dd5509e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] No waiting events found dispatching network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:26 user nova-compute[73110]: WARNING nova.compute.manager [req-c3988dd1-dacd-4c3b-9aec-961a36fbef13 req-6ef2c0e4-f386-45bf-bfd6-ffd29e795515 service nova] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Received unexpected event network-vif-plugged-f538e59c-27ee-4d26-8552-37085b5df9a5 for instance with vm_state deleted and task_state None.
Aug 26 18:04:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:04:28 user nova-compute[73110]: INFO nova.compute.claims [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Claim successful on node user
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:04:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:04:28 user nova-compute[73110]: INFO nova.virt.block_device [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Booting with volume snapshot ab1bef46-3b71-4eb8-8dd0-a3595f5053cd at /dev/vda
Aug 26 18:04:28 user nova-compute[73110]: DEBUG nova.policy [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:04:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Successfully created port: 00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Successfully updated port: 00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-changed-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Refreshing instance network info cache due to event network-changed-00b3b9a3-8bcc-469f-a863-47ff42f1268f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] Acquiring lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updating instance_info_cache with network_info: [{"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Instance network_info: |[{"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] Acquired lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Refreshing network info cache for port 00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updated VIF entry in instance network info cache for port 00b3b9a3-8bcc-469f-a863-47ff42f1268f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updating instance_info_cache with network_info: [{"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e85b7d99-023a-446e-9933-e40e9eab9ab9 req-5f7cbec6-efd5-4f84-aba5-6424856e9744 service nova] Releasing lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.utils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[643aa658-376f-45ab-bc10-8d059b9ab0f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe734eeb-ef5d-4c50-ba70-237f3973a4da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9043a4-9372-4376-8492-50a1c38916e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba0b93d-dc76-4f34-bf41-f8b449ac1745]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:04:34 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:04:34 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9337f098-d43c-485b-bb75-2b91c6393e30]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG os_brick.utils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updating existing volume attachment record: f26f401a-d7b6-4a57-ba5c-ab461d5e5e67 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:04:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:35 user nova-compute[73110]: INFO nova.compute.manager [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Unrescuing
Aug 26 18:04:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquired lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:35 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [{"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Releasing lock "refresh_cache-e6aca42c-964c-4f78-b4c7-84457922c215" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'flavor' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:36 user nova-compute[73110]: WARNING nova.compute.manager [req-01d78df2-e404-4857-bbfe-7b0e5222194e req-c040a0a9-5da8-42df-879f-56c5c2ee4e85 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:04:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance destroyed successfully.
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:38 user nova-compute[73110]: WARNING nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:04:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:38 user nova-compute[73110]: DEBUG nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:38 user nova-compute[73110]: WARNING nova.compute.manager [req-4a2df084-bf78-4261-8065-49c4a514932b req-3b713f2e-37de-47a7-829e-f07436d84ac1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state rescued and task_state unrescuing.
Aug 26 18:04:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073065.229872, d366204d-db04-4f07-8dfc-08dd5509e3d9 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:04:40 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] VM Stopped (Lifecycle Event)
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b4c3433d-0e1d-4fc8-b150-8dc0e71a9c34 None None] [instance: d366204d-db04-4f07-8dfc-08dd5509e3d9] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for e6aca42c-964c-4f78-b4c7-84457922c215 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073080.4630072, e6aca42c-964c-4f78-b4c7-84457922c215 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:04:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Resumed (Lifecycle Event)
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0d9ca699-81f0-45ab-ab3c-2a3a5f8f0aa5 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:04:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073080.4666069, e6aca42c-964c-4f78-b4c7-84457922c215 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:04:40 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Started (Lifecycle Event)
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:04:40 user nova-compute[73110]: WARNING nova.compute.manager [req-07b18b5c-052d-4de5-8164-39b25572b794 req-ae4c2085-21ab-448b-9c75-4de6a81ab000 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state active and task_state None.
Aug 26 18:04:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing instance network info cache due to event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:04:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:44 user nova-compute[73110]: DEBUG nova.network.neutron [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:04:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:45 user nova-compute[73110]: DEBUG nova.network.neutron [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updated VIF entry in instance network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:04:45 user nova-compute[73110]: DEBUG nova.network.neutron [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62f50fc4-8221-48e9-a84a-071007f7b4f1 req-5ef725a9-033d-4cf3-8ec8-910474d9c142 service nova] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:46 user nova-compute[73110]: INFO nova.compute.manager [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Attaching volume b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 to /dev/vdb
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.utils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925f3fc-d55c-481c-a261-d4e39aeeaf6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaca452-6ade-41a9-ac2f-aba8f66b7c20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6ec35-6060-43ea-8823-aafb9a7348db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b987bf9-82bb-4d31-9859-ae268e7b6a16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:04:46 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:04:46 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6211a627-eba1-4bd4-bc60-15618cde263c]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG os_brick.utils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:04:46 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating existing volume attachment record: 4fd580a3-c96d-488e-87b6-9b0ef67a341f {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:04:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG nova.compute.manager [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing instance network info cache due to event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG nova.network.neutron [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:04:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:55 user nova-compute[73110]: INFO nova.compute.manager [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Detaching volume 6b527daa-c8eb-4041-9cb9-93f261e3f32a
Aug 26 18:04:55 user nova-compute[73110]: INFO nova.virt.block_device [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Attempting to driver detach volume 6b527daa-c8eb-4041-9cb9-93f261e3f32a from mountpoint /dev/vdb
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Attempting to detach device vdb from instance 158e68cf-4eba-4b8b-956c-4eeff158119b from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:04:55 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:04:55 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:04:55 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:04:55 user nova-compute[73110]:   <serial>6b527daa-c8eb-4041-9cb9-93f261e3f32a</serial>
Aug 26 18:04:55 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:04:55 user nova-compute[73110]: </disk>
Aug 26 18:04:55 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:04:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully detached device vdb from instance 158e68cf-4eba-4b8b-956c-4eeff158119b from the persistent domain config.
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 158e68cf-4eba-4b8b-956c-4eeff158119b from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:04:55 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:04:55 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:04:55 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:04:55 user nova-compute[73110]:   <serial>6b527daa-c8eb-4041-9cb9-93f261e3f32a</serial>
Aug 26 18:04:55 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:04:55 user nova-compute[73110]: </disk>
Aug 26 18:04:55 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updated VIF entry in instance network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.network.neutron [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a31e70c0-a939-4083-8f18-3d62287a81ff req-65b56b45-c554-4e24-bf31-cf206fa80e95 service nova] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073095.5258281, 158e68cf-4eba-4b8b-956c-4eeff158119b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:04:55 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully detached device vdb from instance 158e68cf-4eba-4b8b-956c-4eeff158119b from the live domain config.
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEfPmWdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:04:55 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[36935dc4-0fe1-4ad8-8061-4ba5528fc9c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca610f-47aa-49cd-84b9-ed082fd90a53]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5441ef9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[973bfd47-07a6-438e-ac2a-b3958f5b1c0a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9656085-6b7c-4219-8121-21638337960b]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c5ccc-fe82-4807-98f1-9209302ba312]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e94a3a-a25c-494c-989d-0bcab7561190]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1ab9f8-168e-45b2-8787-4693efbd455e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea4981-9aab-4bca-b07f-1f74d5b3e212]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260]
Aug 26 18:04:55 user nova-compute[73110]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a, portal: 172.16.0.220,3260] successful.
Aug 26 18:04:55 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b527daa-c8eb-4041-9cb9-93f261e3f32a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4745a831-fe5a-4f00-8a17-77dc17c12b6d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] <== disconnect_volume: return (284ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:04:55 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG nova.compute.manager [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing instance network info cache due to event network-changed-065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] Acquiring lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] Acquired lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG nova.network.neutron [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Refreshing network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG nova.objects.instance [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'flavor' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:04:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-68c6b247-b64c-4936-ad2c-87fe2f2c9bd5 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updated VIF entry in instance network info cache for port 065c6b2d-1fe3-4338-ab38-06c1b57c2a59. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:04:57 user nova-compute[73110]: DEBUG nova.network.neutron [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [{"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:04:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62ea6b7f-0f07-4c12-a29f-b14c8a87eb10 req-b4d449ac-5006-4fdb-9fb7-eb6602d5fb2f service nova] Releasing lock "refresh_cache-158e68cf-4eba-4b8b-956c-4eeff158119b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXbnqOUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:04:58 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:04:58 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:04:58 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff62d74-48b0-43c7-8311-9309f7ae43f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:04:58 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5809bb6-ab40-44ca-adc6-a0d597404a86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3] added
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7621829e-cc99-4ae8-84cd-b0d0f2fcad8d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe1560-4265-42ca-8d14-8543106c04d7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXbnqOUH {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RXbnqOUH" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[127447ce-15e8-4f44-a5f3-cca3b594338d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RXbnqOUH'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee12095-adb0-4aab-bbb4-e1764fffeea8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c41541-8aa4-4c41-8719-b1c35718753a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0026ba-a82e-4624-8aa1-c3df6c3926ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260]
Aug 26 18:04:58 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260] successful.
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa467f-7fd0-484b-bdba-9cb8e5693bc9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[206670db-89c2-425b-9ed4-6b2d756f0a2e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:04:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93ac92-31a8-4b05-a258-168ab6ac7e70]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:04:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXbnqOUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23838646664343132', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838646664343132', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:04:59 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:04:59 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:04:59 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:04:59 user nova-compute[73110]:   <serial>b47514d6-5442-4df5-b9f9-86c9bbc7f4b3</serial>
Aug 26 18:04:59 user nova-compute[73110]: </disk>
Aug 26 18:04:59 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:04:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Creating image(s)
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Ensure instance console log exists: /opt/stack/data/nova/instances/d590856d-4739-4fc5-a2b9-d19f7526de4c/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Start _get_guest_xml network_info=[{"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T18:04:17Z,direct_url=<?>,disk_format='qcow2',id=f624ba6d-08a0-4611-9316-940f89913fa3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-871861821',owner='a6bd13facc61422f933beabd7d82e2a6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T18:04:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f26f401a-d7b6-4a57-ba5c-ab461d5e5e67', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjOtHbUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd590856d-4739-4fc5-a2b9-d19f7526de4c', 'attached_at': '', 'detached_at': '', 'volume_id': '977caf2f-8afb-4b5e-8147-64d6b8dc2de0', 'serial': '977caf2f-8afb-4b5e-8147-64d6b8dc2de0'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:04:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:04:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T18:04:17Z,direct_url=<?>,disk_format='qcow2',id=f624ba6d-08a0-4611-9316-940f89913fa3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-871861821',owner='a6bd13facc61422f933beabd7d82e2a6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T18:04:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:04:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjOtHbUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:05:00 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:05:00 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:05:00 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[80472e0e-408d-4424-afd8-814c4a5377e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:05:00 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No VIF found with MAC fa:16:3e:11:9a:f6, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9fbf3f-2616-4097-8bfe-d6476417ab52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0] added
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a742502-8fb0-41f9-bb84-f3092fd3b6c1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffd0c2-f914-4e15-9178-65be8f308ca0]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjOtHbUp {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjOtHbUp" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[545309b6-9217-49ed-8254-0cb844af274c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjOtHbUp'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d0729c-f57d-4a04-b3e3-bced48f63d14]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b89506f0-19ed-4ab4-a438-8c26fdf68644 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.826s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6c245b-7e57-49cc-ae00-aebdfefb187d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[866acf13-0713-4245-80b3-766d35fab21a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260]
Aug 26 18:05:00 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260] successful.
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0370ff-a663-4b42-999b-200944c830b5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e069e6b-c0ba-4407-895f-c1face8c9246]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:05:00 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7432a8-d1a3-40b8-809c-eca76a0fdb34]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:00 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjOtHbUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23836646666373865', 'path': '/dev/sdf'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836646666373865', 'path': '/dev/sdf'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1441085046',id=42,image_ref='f624ba6d-08a0-4611-9316-940f89913fa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSn+0rrjdnYJcIc7izhdeJ+cpuKyr3mQwDIOLroNNExhwUdI0YtyuEYrzG2pu0nZa7Z6xGngruGc96dQFhJ+KAXTwtJGsWAupqLwNmBcJVvkRPR9zzdV0VGYlbD0qFBnA==',key_name='tempest-keypair-1546146854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-6zsonj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2126809828',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:04:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=d590856d-4739-4fc5-a2b9-d19f7526de4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.objects.instance [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid d590856d-4739-4fc5-a2b9-d19f7526de4c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:05:01 user nova-compute[73110]:   <uuid>d590856d-4739-4fc5-a2b9-d19f7526de4c</uuid>
Aug 26 18:05:01 user nova-compute[73110]:   <name>instance-0000002a</name>
Aug 26 18:05:01 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:05:01 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:05:01 user nova-compute[73110]:   <metadata>
Aug 26 18:05:01 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:05:01 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1441085046</nova:name>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:04:59</nova:creationTime>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:05:01 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:05:01 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:owner>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 18:05:01 user nova-compute[73110]:       </nova:owner>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:root type="image" uuid="f624ba6d-08a0-4611-9316-940f89913fa3"/>
Aug 26 18:05:01 user nova-compute[73110]:       <nova:ports>
Aug 26 18:05:01 user nova-compute[73110]:         <nova:port uuid="00b3b9a3-8bcc-469f-a863-47ff42f1268f">
Aug 26 18:05:01 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 18:05:01 user nova-compute[73110]:         </nova:port>
Aug 26 18:05:01 user nova-compute[73110]:       </nova:ports>
Aug 26 18:05:01 user nova-compute[73110]:     </nova:instance>
Aug 26 18:05:01 user nova-compute[73110]:   </metadata>
Aug 26 18:05:01 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:05:01 user nova-compute[73110]:     <system>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="serial">d590856d-4739-4fc5-a2b9-d19f7526de4c</entry>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="uuid">d590856d-4739-4fc5-a2b9-d19f7526de4c</entry>
Aug 26 18:05:01 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:05:01 user nova-compute[73110]:     </system>
Aug 26 18:05:01 user nova-compute[73110]:   </sysinfo>
Aug 26 18:05:01 user nova-compute[73110]:   <os>
Aug 26 18:05:01 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:05:01 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:05:01 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:05:01 user nova-compute[73110]:   </os>
Aug 26 18:05:01 user nova-compute[73110]:   <features>
Aug 26 18:05:01 user nova-compute[73110]:     <acpi/>
Aug 26 18:05:01 user nova-compute[73110]:     <apic/>
Aug 26 18:05:01 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:05:01 user nova-compute[73110]:   </features>
Aug 26 18:05:01 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:05:01 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:05:01 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:05:01 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:05:01 user nova-compute[73110]:   </clock>
Aug 26 18:05:01 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:05:01 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:05:01 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:05:01 user nova-compute[73110]:   </cpu>
Aug 26 18:05:01 user nova-compute[73110]:   <devices>
Aug 26 18:05:01 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:05:01 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:05:01 user nova-compute[73110]:       <source dev="/dev/sdf"/>
Aug 26 18:05:01 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:05:01 user nova-compute[73110]:       <serial>977caf2f-8afb-4b5e-8147-64d6b8dc2de0</serial>
Aug 26 18:05:01 user nova-compute[73110]:     </disk>
Aug 26 18:05:01 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:05:01 user nova-compute[73110]:       <mac address="fa:16:3e:63:87:d9"/>
Aug 26 18:05:01 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:05:01 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:05:01 user nova-compute[73110]:       <target dev="tap00b3b9a3-8b"/>
Aug 26 18:05:01 user nova-compute[73110]:     </interface>
Aug 26 18:05:01 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:05:01 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/d590856d-4739-4fc5-a2b9-d19f7526de4c/console.log" append="off"/>
Aug 26 18:05:01 user nova-compute[73110]:     </serial>
Aug 26 18:05:01 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:05:01 user nova-compute[73110]:     <video>
Aug 26 18:05:01 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:05:01 user nova-compute[73110]:     </video>
Aug 26 18:05:01 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:05:01 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:05:01 user nova-compute[73110]:     </rng>
Aug 26 18:05:01 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:05:01 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:05:01 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:05:01 user nova-compute[73110]:     </memballoon>
Aug 26 18:05:01 user nova-compute[73110]:   </devices>
Aug 26 18:05:01 user nova-compute[73110]: </domain>
Aug 26 18:05:01 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1441085046',id=42,image_ref='f624ba6d-08a0-4611-9316-940f89913fa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSn+0rrjdnYJcIc7izhdeJ+cpuKyr3mQwDIOLroNNExhwUdI0YtyuEYrzG2pu0nZa7Z6xGngruGc96dQFhJ+KAXTwtJGsWAupqLwNmBcJVvkRPR9zzdV0VGYlbD0qFBnA==',key_name='tempest-keypair-1546146854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-6zsonj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2126809828',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:04:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=d590856d-4739-4fc5-a2b9-d19f7526de4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG os_vif [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00b3b9a3-8b, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00b3b9a3-8b, col_values=(('external_ids', {'iface-id': '00b3b9a3-8bcc-469f-a863-47ff42f1268f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:87:d9', 'vm-uuid': 'd590856d-4739-4fc5-a2b9-d19f7526de4c'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:01 user nova-compute[73110]: INFO os_vif [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b')
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:05:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:63:87:d9, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:02 user nova-compute[73110]: INFO nova.compute.manager [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Detaching volume b47514d6-5442-4df5-b9f9-86c9bbc7f4b3
Aug 26 18:05:02 user nova-compute[73110]: INFO nova.virt.block_device [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Attempting to driver detach volume b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 from mountpoint /dev/vdb
Aug 26 18:05:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Attempting to detach device vdb from instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:05:02 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:05:02 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:05:02 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:05:02 user nova-compute[73110]:   <serial>b47514d6-5442-4df5-b9f9-86c9bbc7f4b3</serial>
Aug 26 18:05:02 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:05:02 user nova-compute[73110]: </disk>
Aug 26 18:05:02 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:05:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully detached device vdb from instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a from the persistent domain config.
Aug 26 18:05:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:05:02 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:05:02 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:05:02 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:05:02 user nova-compute[73110]:   <serial>b47514d6-5442-4df5-b9f9-86c9bbc7f4b3</serial>
Aug 26 18:05:02 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:05:02 user nova-compute[73110]: </disk>
Aug 26 18:05:02 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] No waiting events found dispatching network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:03 user nova-compute[73110]: WARNING nova.compute.manager [req-536e1ba4-73d4-49a8-9f56-7cc1d8fbdc21 req-31da97ca-bc29-4c8f-baa7-f439f84a8db5 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received unexpected event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f for instance with vm_state building and task_state spawning.
Aug 26 18:05:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073103.573479, 1d17f7fc-88c5-4270-9249-52dbe3d9354a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:05:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully detached device vdb from instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a from the live domain config.
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RXbnqOUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:05:03 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f7796-08bf-44a3-a1f0-27a49bfa5894]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7213270e-f8b4-4e94-9770-780231d34711]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:05:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d3bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e6f36c-dbdc-4579-9694-f2c5970d3f1e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7484d1-8ef0-437b-b810-3f20e4367ddd]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f15ca4-b562-43ab-bec0-c1f7ab76ba6b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466c4e7-e78d-4966-bac0-d4c8dea8fe02]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd83fad-b2ea-4314-966e-af29abc4e9e6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[93022295-83b1-421b-a0eb-0467dedd8518]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260]
Aug 26 18:05:03 user nova-compute[73110]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3, portal: 172.16.0.220,3260] successful.
Aug 26 18:05:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b47514d6-5442-4df5-b9f9-86c9bbc7f4b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc4c2ef-90e9-4cd7-9ed4-f71f00e74652]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== disconnect_volume: return (381ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:05:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:05:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] No waiting events found dispatching network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:05 user nova-compute[73110]: WARNING nova.compute.manager [req-73325d3a-1029-4dbe-a20b-d8620698675a req-d99c924d-2699-483b-a95e-24250cf0d101 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received unexpected event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f for instance with vm_state building and task_state spawning.
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073105.6638849, d590856d-4739-4fc5-a2b9-d19f7526de4c => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] VM Resumed (Lifecycle Event)
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Instance spawned successfully.
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073105.6643212, d590856d-4739-4fc5-a2b9-d19f7526de4c => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] VM Started (Lifecycle Event)
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 26 18:05:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:05:05 user nova-compute[73110]: INFO nova.compute.manager [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Took 37.92 seconds to build instance.
Aug 26 18:05:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-331c03e5-0a1b-41cb-82c3-a47a937adc9c tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.026s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:06 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:05:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:07 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:05:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5558b931-a2e0-4b17-b6ed-aa4d7ce22848 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updating instance_info_cache with network_info: [{"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-9020d47e-a37b-4695-9ab7-4c0c5563f958" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:05:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:05:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:05:16 user nova-compute[73110]: INFO nova.compute.claims [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Claim successful on node user
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:05:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.policy [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ac81964ee54d3296747f0a389aeacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91abd0a8954494b86983642950796fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:05:16 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Creating image(s)
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "/opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "/opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "/opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk 1073741824" returned: 0 in 0.055s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Successfully created port: 6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Cannot resize image /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Ensure instance console log exists: /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Successfully updated port: 6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-changed-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Refreshing instance network info cache due to event network-changed-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] Acquiring lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] Acquired lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Refreshing network info cache for port 6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407cdd0f-8c34-4bba-9bed-02a3126e77ef req-c1f69248-f15c-42e4-9827-09d851e2b4e8 service nova] Releasing lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquired lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Updating instance_info_cache with network_info: [{"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Releasing lock "refresh_cache-aed0af97-da39-48c6-854b-16c80b679c19" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance network_info: |[{"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Start _get_guest_xml network_info=[{"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:05:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:05:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-730602915',display_name='tempest-VolumesActionsTest-instance-730602915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-730602915',id=43,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-qcasjurv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:05:17Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=aed0af97-da39-48c6-854b-16c80b679c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.objects.instance [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lazy-loading 'pci_devices' on Instance uuid aed0af97-da39-48c6-854b-16c80b679c19 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:05:19 user nova-compute[73110]:   <uuid>aed0af97-da39-48c6-854b-16c80b679c19</uuid>
Aug 26 18:05:19 user nova-compute[73110]:   <name>instance-0000002b</name>
Aug 26 18:05:19 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:05:19 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:05:19 user nova-compute[73110]:   <metadata>
Aug 26 18:05:19 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:05:19 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:name>tempest-VolumesActionsTest-instance-730602915</nova:name>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:05:19</nova:creationTime>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:05:19 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:05:19 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:owner>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:user uuid="64ac81964ee54d3296747f0a389aeacf">tempest-VolumesActionsTest-38073166-project-member</nova:user>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:project uuid="f91abd0a8954494b86983642950796fd">tempest-VolumesActionsTest-38073166</nova:project>
Aug 26 18:05:19 user nova-compute[73110]:       </nova:owner>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:05:19 user nova-compute[73110]:       <nova:ports>
Aug 26 18:05:19 user nova-compute[73110]:         <nova:port uuid="6d21ef0d-2da8-41aa-91d4-dec5f5668c9a">
Aug 26 18:05:19 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 18:05:19 user nova-compute[73110]:         </nova:port>
Aug 26 18:05:19 user nova-compute[73110]:       </nova:ports>
Aug 26 18:05:19 user nova-compute[73110]:     </nova:instance>
Aug 26 18:05:19 user nova-compute[73110]:   </metadata>
Aug 26 18:05:19 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:05:19 user nova-compute[73110]:     <system>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="serial">aed0af97-da39-48c6-854b-16c80b679c19</entry>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="uuid">aed0af97-da39-48c6-854b-16c80b679c19</entry>
Aug 26 18:05:19 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:05:19 user nova-compute[73110]:     </system>
Aug 26 18:05:19 user nova-compute[73110]:   </sysinfo>
Aug 26 18:05:19 user nova-compute[73110]:   <os>
Aug 26 18:05:19 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:05:19 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:05:19 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:05:19 user nova-compute[73110]:   </os>
Aug 26 18:05:19 user nova-compute[73110]:   <features>
Aug 26 18:05:19 user nova-compute[73110]:     <acpi/>
Aug 26 18:05:19 user nova-compute[73110]:     <apic/>
Aug 26 18:05:19 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:05:19 user nova-compute[73110]:   </features>
Aug 26 18:05:19 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:05:19 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:05:19 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:05:19 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:05:19 user nova-compute[73110]:   </clock>
Aug 26 18:05:19 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:05:19 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:05:19 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:05:19 user nova-compute[73110]:   </cpu>
Aug 26 18:05:19 user nova-compute[73110]:   <devices>
Aug 26 18:05:19 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:05:19 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:05:19 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk"/>
Aug 26 18:05:19 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:05:19 user nova-compute[73110]:     </disk>
Aug 26 18:05:19 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:05:19 user nova-compute[73110]:       <mac address="fa:16:3e:75:5d:b3"/>
Aug 26 18:05:19 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:05:19 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:05:19 user nova-compute[73110]:       <target dev="tap6d21ef0d-2d"/>
Aug 26 18:05:19 user nova-compute[73110]:     </interface>
Aug 26 18:05:19 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:05:19 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/console.log" append="off"/>
Aug 26 18:05:19 user nova-compute[73110]:     </serial>
Aug 26 18:05:19 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:05:19 user nova-compute[73110]:     <video>
Aug 26 18:05:19 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:05:19 user nova-compute[73110]:     </video>
Aug 26 18:05:19 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:05:19 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:05:19 user nova-compute[73110]:     </rng>
Aug 26 18:05:19 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:05:19 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:05:19 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:05:19 user nova-compute[73110]:     </memballoon>
Aug 26 18:05:19 user nova-compute[73110]:   </devices>
Aug 26 18:05:19 user nova-compute[73110]: </domain>
Aug 26 18:05:19 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-730602915',display_name='tempest-VolumesActionsTest-instance-730602915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-730602915',id=43,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-qcasjurv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:05:17Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=aed0af97-da39-48c6-854b-16c80b679c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG os_vif [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d21ef0d-2d, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d21ef0d-2d, col_values=(('external_ids', {'iface-id': '6d21ef0d-2da8-41aa-91d4-dec5f5668c9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:5d:b3', 'vm-uuid': 'aed0af97-da39-48c6-854b-16c80b679c19'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:19 user nova-compute[73110]: INFO os_vif [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d')
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] No VIF found with MAC fa:16:3e:75:5d:b3, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:05:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:05:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=24.950538635253906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 158e68cf-4eba-4b8b-956c-4eeff158119b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 512050ec-35e7-4bfa-8919-011f856986f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d590856d-4739-4fc5-a2b9-d19f7526de4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance aed0af97-da39-48c6-854b-16c80b679c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:05:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] No waiting events found dispatching network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:21 user nova-compute[73110]: WARNING nova.compute.manager [req-57eaa6bb-25e9-40d3-840f-275e7407d5f7 req-5323fd9c-e507-4cbe-93e4-b98e54054339 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received unexpected event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a for instance with vm_state building and task_state spawning.
Aug 26 18:05:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073123.049189, aed0af97-da39-48c6-854b-16c80b679c19 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] VM Resumed (Lifecycle Event)
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance spawned successfully.
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073123.0549328, aed0af97-da39-48c6-854b-16c80b679c19 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] VM Started (Lifecycle Event)
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] No waiting events found dispatching network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:23 user nova-compute[73110]: WARNING nova.compute.manager [req-bdfaac4a-b494-4f22-b1cc-e2fc1cd81f02 req-e5b06c0e-6250-406b-93c6-10e0d895444c service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received unexpected event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a for instance with vm_state building and task_state spawning.
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 26 18:05:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:05:23 user nova-compute[73110]: INFO nova.compute.manager [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Took 7.28 seconds to build instance.
Aug 26 18:05:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-786c4ffc-af35-4f7f-ad7d-14ed0292c516 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.376s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:05:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:45 user nova-compute[73110]: INFO nova.compute.manager [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Terminating instance
Aug 26 18:05:45 user nova-compute[73110]: DEBUG nova.compute.manager [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-8dbb89f0-959c-47aa-85e7-19e2758bb289 req-087a79f1-8c6c-40c9-9a2a-113f7b40501d service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Instance destroyed successfully.
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.objects.instance [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid 158e68cf-4eba-4b8b-956c-4eeff158119b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-19789833',display_name='tempest-ServerRescueNegativeTestJSON-server-19789833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-19789833',id=35,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqTVYxY6AZqGuMrgmAHbd5F1aKTfzf8+/H6j545GJXhO1/wLJ5skKl+NBjGQ/TpfbFdz3L/TZSitHHX72pR8a3BJo676S7GrKbgcgMbZQGL1M3ppvexjD02HbfaxMJiKg==',key_name='tempest-keypair-662086693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-wwzx9dii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=158e68cf-4eba-4b8b-956c-4eeff158119b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "address": "fa:16:3e:59:4a:4f", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065c6b2d-1f", "ovs_interfaceid": "065c6b2d-1fe3-4338-ab38-06c1b57c2a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG os_vif [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap065c6b2d-1f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:05:46 user nova-compute[73110]: INFO os_vif [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:4f,bridge_name='br-int',has_traffic_filtering=True,id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065c6b2d-1f')
Aug 26 18:05:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Deleting instance files /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b_del
Aug 26 18:05:46 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Deletion of /opt/stack/data/nova/instances/158e68cf-4eba-4b8b-956c-4eeff158119b_del complete
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: INFO nova.compute.manager [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 18:05:46 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:05:47 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Took 0.95 seconds to deallocate network for instance.
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-3c8a081e-e504-4fac-8127-05610c4f2574 req-272b06d5-b99f-4f82-a3ed-aa252da4d9d1 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-deleted-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: INFO nova.compute.manager [req-3c8a081e-e504-4fac-8127-05610c4f2574 req-272b06d5-b99f-4f82-a3ed-aa252da4d9d1 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Neutron deleted interface 065c6b2d-1fe3-4338-ab38-06c1b57c2a59; detaching it from the instance and deleting it from the info cache
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.network.neutron [req-3c8a081e-e504-4fac-8127-05610c4f2574 req-272b06d5-b99f-4f82-a3ed-aa252da4d9d1 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-3c8a081e-e504-4fac-8127-05610c4f2574 req-272b06d5-b99f-4f82-a3ed-aa252da4d9d1 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Detach interface failed, port_id=065c6b2d-1fe3-4338-ab38-06c1b57c2a59, reason: Instance 158e68cf-4eba-4b8b-956c-4eeff158119b could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Deleted allocations for instance 158e68cf-4eba-4b8b-956c-4eeff158119b
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-bdf25594-ef3d-428f-b96e-36236672a0b9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:47 user nova-compute[73110]: WARNING nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state deleted and task_state None.
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:47 user nova-compute[73110]: WARNING nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state deleted and task_state None.
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:47 user nova-compute[73110]: WARNING nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state deleted and task_state None.
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:47 user nova-compute[73110]: WARNING nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-unplugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state deleted and task_state None.
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Acquiring lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] Lock "158e68cf-4eba-4b8b-956c-4eeff158119b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:05:47 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] No waiting events found dispatching network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:05:47 user nova-compute[73110]: WARNING nova.compute.manager [req-6bfbe49c-97e5-4260-9ed2-ba60979e503c req-5c2b43ba-e775-4afe-81cb-ee1b6eb70e40 service nova] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Received unexpected event network-vif-plugged-065c6b2d-1fe3-4338-ab38-06c1b57c2a59 for instance with vm_state deleted and task_state None.
Aug 26 18:05:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:05:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073146.1799111, 158e68cf-4eba-4b8b-956c-4eeff158119b => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:06:01 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] VM Stopped (Lifecycle Event)
Aug 26 18:06:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-da8d8572-b938-44c4-ab7d-c820d768d7c6 None None] [instance: 158e68cf-4eba-4b8b-956c-4eeff158119b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:06:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:03 user nova-compute[73110]: INFO nova.compute.manager [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] instance snapshotting
Aug 26 18:06:03 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Beginning live snapshot process
Aug 26 18:06:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json -f qcow2 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4.delta 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4.delta 1073741824" returned: 0 in 0.052s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:04 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 18:06:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 18:06:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73110) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 18:06:05 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 18:06:05 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 18:06:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4.delta /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4.delta /opt/stack/data/nova/instances/snapshots/tmpo2bwxfty/d57908df1ade4ba4917bf6eee2f6d0f4" returned: 0 in 0.480s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Snapshot extracted, beginning image upload
Aug 26 18:06:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:08 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:06:08 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Snapshot image upload complete
Aug 26 18:06:08 user nova-compute[73110]: INFO nova.compute.manager [None req-86ec91f8-d764-4b9d-a7f0-9371954020e2 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Took 5.27 seconds to snapshot the instance on the hypervisor.
Aug 26 18:06:09 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:06:11 user nova-compute[73110]: INFO nova.compute.claims [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Claim successful on node user
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:06:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:06:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.policy [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e166fb79ac46669ca6580d0bb1b6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205df4d98cf24ae48843664efb353420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:06:12 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Creating image(s)
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "/opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "/opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.part --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG nova.virt.images [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] aa8b48d0-6056-4d51-a85a-0e81cbdaf925 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.part /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Successfully created port: 2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.part /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.converted" returned: 0 in 0.415s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.050s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Successfully updated port: 2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea,backing_fmt=raw /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-changed-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing instance network info cache due to event network-changed-2ea934be-c527-4731-a794-d1ecd160d126. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] Acquiring lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] Acquired lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing network info cache for port 2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea,backing_fmt=raw /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk 1073741824" returned: 0 in 0.063s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "8d517b37aa25a88cfce0ca17084858e7ca851dea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Ensure instance console log exists: /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-88839063-fa44-4bbb-a0cd-62984c7dc3e7 req-4ebef162-5184-4d4b-903e-7d8d140e8b79 service nova] Releasing lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquired lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [{"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Releasing lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance network_info: |[{"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Start _get_guest_xml network_info=[{"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d81c241080eb88c16b17f89efeef0508',container_format='bare',created_at=2023-08-26T18:06:03Z,direct_url=<?>,disk_format='qcow2',id=aa8b48d0-6056-4d51-a85a-0e81cbdaf925,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1865676698',owner='205df4d98cf24ae48843664efb353420',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T18:06:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': 'aa8b48d0-6056-4d51-a85a-0e81cbdaf925'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:06:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:06:15 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d81c241080eb88c16b17f89efeef0508',container_format='bare',created_at=2023-08-26T18:06:03Z,direct_url=<?>,disk_format='qcow2',id=aa8b48d0-6056-4d51-a85a-0e81cbdaf925,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1865676698',owner='205df4d98cf24ae48843664efb353420',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T18:06:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-599720899',display_name='tempest-TestStampPattern-server-599720899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-599720899',id=44,image_ref='aa8b48d0-6056-4d51-a85a-0e81cbdaf925',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-bgtstoo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1d17f7fc-88c5-4270-9249-52dbe3d9354a',image_min_disk='1',image_min_ram='0',image_owner_id='205df4d98cf24ae48843664efb353420',image_owner_project_name='tempest-TestStampPattern-277351961',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277351961-project-member',image_user_id='62e166fb79ac46669ca6580d0bb1b6eb',network_allocated='True',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:06:12Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:06:15 user nova-compute[73110]:   <uuid>3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0</uuid>
Aug 26 18:06:15 user nova-compute[73110]:   <name>instance-0000002c</name>
Aug 26 18:06:15 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:06:15 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:06:15 user nova-compute[73110]:   <metadata>
Aug 26 18:06:15 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:06:15 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:name>tempest-TestStampPattern-server-599720899</nova:name>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:06:15</nova:creationTime>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:06:15 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:06:15 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:owner>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:user uuid="62e166fb79ac46669ca6580d0bb1b6eb">tempest-TestStampPattern-277351961-project-member</nova:user>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:project uuid="205df4d98cf24ae48843664efb353420">tempest-TestStampPattern-277351961</nova:project>
Aug 26 18:06:15 user nova-compute[73110]:       </nova:owner>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:root type="image" uuid="aa8b48d0-6056-4d51-a85a-0e81cbdaf925"/>
Aug 26 18:06:15 user nova-compute[73110]:       <nova:ports>
Aug 26 18:06:15 user nova-compute[73110]:         <nova:port uuid="2ea934be-c527-4731-a794-d1ecd160d126">
Aug 26 18:06:15 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 18:06:15 user nova-compute[73110]:         </nova:port>
Aug 26 18:06:15 user nova-compute[73110]:       </nova:ports>
Aug 26 18:06:15 user nova-compute[73110]:     </nova:instance>
Aug 26 18:06:15 user nova-compute[73110]:   </metadata>
Aug 26 18:06:15 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:06:15 user nova-compute[73110]:     <system>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="serial">3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0</entry>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="uuid">3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0</entry>
Aug 26 18:06:15 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:06:15 user nova-compute[73110]:     </system>
Aug 26 18:06:15 user nova-compute[73110]:   </sysinfo>
Aug 26 18:06:15 user nova-compute[73110]:   <os>
Aug 26 18:06:15 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:06:15 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:06:15 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:06:15 user nova-compute[73110]:   </os>
Aug 26 18:06:15 user nova-compute[73110]:   <features>
Aug 26 18:06:15 user nova-compute[73110]:     <acpi/>
Aug 26 18:06:15 user nova-compute[73110]:     <apic/>
Aug 26 18:06:15 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:06:15 user nova-compute[73110]:   </features>
Aug 26 18:06:15 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:06:15 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:06:15 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:06:15 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:06:15 user nova-compute[73110]:   </clock>
Aug 26 18:06:15 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:06:15 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:06:15 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:06:15 user nova-compute[73110]:   </cpu>
Aug 26 18:06:15 user nova-compute[73110]:   <devices>
Aug 26 18:06:15 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:06:15 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:06:15 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk"/>
Aug 26 18:06:15 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:06:15 user nova-compute[73110]:     </disk>
Aug 26 18:06:15 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:06:15 user nova-compute[73110]:       <mac address="fa:16:3e:fa:f4:ed"/>
Aug 26 18:06:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:06:15 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:06:15 user nova-compute[73110]:       <target dev="tap2ea934be-c5"/>
Aug 26 18:06:15 user nova-compute[73110]:     </interface>
Aug 26 18:06:15 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:06:15 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/console.log" append="off"/>
Aug 26 18:06:15 user nova-compute[73110]:     </serial>
Aug 26 18:06:15 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:06:15 user nova-compute[73110]:     <video>
Aug 26 18:06:15 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:06:15 user nova-compute[73110]:     </video>
Aug 26 18:06:15 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:06:15 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:06:15 user nova-compute[73110]:     </rng>
Aug 26 18:06:15 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:06:15 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:06:15 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:06:15 user nova-compute[73110]:     </memballoon>
Aug 26 18:06:15 user nova-compute[73110]:   </devices>
Aug 26 18:06:15 user nova-compute[73110]: </domain>
Aug 26 18:06:15 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-599720899',display_name='tempest-TestStampPattern-server-599720899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-599720899',id=44,image_ref='aa8b48d0-6056-4d51-a85a-0e81cbdaf925',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-bgtstoo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1d17f7fc-88c5-4270-9249-52dbe3d9354a',image_min_disk='1',image_min_ram='0',image_owner_id='205df4d98cf24ae48843664efb353420',image_owner_project_name='tempest-TestStampPattern-277351961',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277351961-project-member',image_user_id='62e166fb79ac46669ca6580d0bb1b6eb',network_allocated='True',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:06:12Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG os_vif [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea934be-c5, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ea934be-c5, col_values=(('external_ids', {'iface-id': '2ea934be-c527-4731-a794-d1ecd160d126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:f4:ed', 'vm-uuid': '3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:15 user nova-compute[73110]: INFO os_vif [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5')
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:06:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No VIF found with MAC fa:16:3e:fa:f4:ed, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:06:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] No waiting events found dispatching network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:17 user nova-compute[73110]: WARNING nova.compute.manager [req-810e9d76-6de5-4cc5-bc23-6aabed403e8a req-3bbd3af7-580e-4b19-96c5-7ae4f11eb989 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received unexpected event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 for instance with vm_state building and task_state spawning.
Aug 26 18:06:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073179.0397425, 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] VM Resumed (Lifecycle Event)
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance spawned successfully.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] No waiting events found dispatching network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:19 user nova-compute[73110]: WARNING nova.compute.manager [req-f1a0dc91-e214-4b68-bbcc-cf1e65a0960b req-cdac1b8f-06c4-4c9d-83f5-51d317593a53 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received unexpected event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 for instance with vm_state building and task_state spawning.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073179.040364, 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] VM Started (Lifecycle Event)
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:19 user nova-compute[73110]: INFO nova.compute.manager [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Took 8.23 seconds to build instance.
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d02af152-8f54-4637-948b-cb0a1c06b698 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.350s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-changed-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Refreshing instance network info cache due to event network-changed-00b3b9a3-8bcc-469f-a863-47ff42f1268f. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] Acquiring lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] Acquired lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG nova.network.neutron [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Refreshing network info cache for port 00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:20 user nova-compute[73110]: INFO nova.compute.manager [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Terminating instance
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updated VIF entry in instance network info cache for port 00b3b9a3-8bcc-469f-a863-47ff42f1268f. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updating instance_info_cache with network_info: [{"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-295e451c-3a9c-4c84-b4ff-0cbacbcd9c78 req-a58d5bf1-a22e-4134-b81e-9d99bc2c0844 service nova] Releasing lock "refresh_cache-d590856d-4739-4fc5-a2b9-d19f7526de4c" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Instance destroyed successfully.
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid d590856d-4739-4fc5-a2b9-d19f7526de4c {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1441085046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1441085046',id=42,image_ref='f624ba6d-08a0-4611-9316-940f89913fa3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSn+0rrjdnYJcIc7izhdeJ+cpuKyr3mQwDIOLroNNExhwUdI0YtyuEYrzG2pu0nZa7Z6xGngruGc96dQFhJ+KAXTwtJGsWAupqLwNmBcJVvkRPR9zzdV0VGYlbD0qFBnA==',key_name='tempest-keypair-1546146854',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-6zsonj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2126809828',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=d590856d-4739-4fc5-a2b9-d19f7526de4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "address": "fa:16:3e:63:87:d9", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3b9a3-8b", "ovs_interfaceid": "00b3b9a3-8bcc-469f-a863-47ff42f1268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG os_vif [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00b3b9a3-8b, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:06:20 user nova-compute[73110]: INFO os_vif [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:87:d9,bridge_name='br-int',has_traffic_filtering=True,id=00b3b9a3-8bcc-469f-a863-47ff42f1268f,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3b9a3-8b')
Aug 26 18:06:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjOtHbUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:06:20 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:06:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b428023d-b61f-4269-9b63-c5311fffbb30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afabe56-af88-4c79-ba8e-560a0702e27c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 (non-flash)
Aug 26 18:06:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d39b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0'): ({'sdf'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sdf {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96144c8-fb9a-4b40-8837-8e54bd5e762c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c2e40-48f4-4143-9abf-1de721968f2a]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sdf {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd2b2ff-ec52-4a47-ae29-59fa1bf85b53]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a44293-ec55-4073-8deb-3289874e82e5]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sdf have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cea32b7-6e4b-429c-bf1a-4a541416c51e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450dbb6-15a3-4f41-92df-9998bfacefd7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260]
Aug 26 18:06:21 user nova-compute[73110]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0, portal: 172.16.0.220,3260] successful.
Aug 26 18:06:21 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977caf2f-8afb-4b5e-8147-64d6b8dc2de0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e8e1e7-3102-4986-b2ba-36b2016fcc52]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (432ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:06:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Deleting instance files /opt/stack/data/nova/instances/d590856d-4739-4fc5-a2b9-d19f7526de4c_del
Aug 26 18:06:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Deletion of /opt/stack/data/nova/instances/d590856d-4739-4fc5-a2b9-d19f7526de4c_del complete
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: INFO nova.compute.manager [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-unplugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] No waiting events found dispatching network-vif-unplugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-unplugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Acquiring lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] No waiting events found dispatching network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:21 user nova-compute[73110]: WARNING nova.compute.manager [req-f12f5fa7-f6f7-44f4-8ebb-d96e4b844fc3 req-a33a5367-b974-44de-b0c0-fd4d6e7ed953 service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received unexpected event network-vif-plugged-00b3b9a3-8bcc-469f-a863-47ff42f1268f for instance with vm_state active and task_state deleting.
Aug 26 18:06:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:06:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=24.79592514038086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:22 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Took 1.04 seconds to deallocate network for instance.
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-0d89b295-1301-463a-812f-2f5775b2170d req-1a68094b-dbe5-4bd7-83e3-5cddf7c0954e service nova] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Received event network-vif-deleted-00b3b9a3-8bcc-469f-a863-47ff42f1268f {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 573d5b76-ace4-471a-a1d4-5a770389d14f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9020d47e-a37b-4695-9ab7-4c0c5563f958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance e6aca42c-964c-4f78-b4c7-84457922c215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 512050ec-35e7-4bfa-8919-011f856986f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d590856d-4739-4fc5-a2b9-d19f7526de4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance aed0af97-da39-48c6-854b-16c80b679c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:06:22 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:06:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:06:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:26 user nova-compute[73110]: INFO nova.compute.manager [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Terminating instance
Aug 26 18:06:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-c8ca1ed1-4c9a-4b4e-8906-d5657272e655 req-9a786f59-5945-40e9-a46b-a518512595b1 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-unplugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:06:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Instance destroyed successfully.
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid e6aca42c-964c-4f78-b4c7-84457922c215 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1630820214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1630820214',id=38,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-0bghsrgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:04:41Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=e6aca42c-964c-4f78-b4c7-84457922c215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "363252b1-b8e9-4647-82d5-b112af68533d", "address": "fa:16:3e:26:c2:4b", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363252b1-b8", "ovs_interfaceid": "363252b1-b8e9-4647-82d5-b112af68533d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_vif [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap363252b1-b8, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:06:27 user nova-compute[73110]: INFO os_vif [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c2:4b,bridge_name='br-int',has_traffic_filtering=True,id=363252b1-b8e9-4647-82d5-b112af68533d,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363252b1-b8')
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqgLptKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:06:27 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a964f3c-43fe-4787-aa72-cfb1f1303dd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8474c-9851-414a-b685-d47ccc55c521]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:06:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520ef5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[048237a8-f1ba-4e61-8ed6-f6647df8d737]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b67fb8c-e448-43e3-b1e6-3e520e83fac1]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0373e13f-d7b9-4840-8330-10758f17f486]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2346dc-c1a6-440a-b8c3-7892e322cdaf]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26266666634326235', '/dev/disk/by-id/scsi-1SCST_BIO9b5bb075-bfff42b5ebb474f2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9b5bb075') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dbdb11-0508-4a2e-996e-930a3d3e5150]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b52039-2294-4f4a-8060-d8f97a95dda9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcfd8b5-f67c-4b93-a942-5046a947448a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260]
Aug 26 18:06:27 user nova-compute[73110]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79, portal: 172.16.0.220,3260] successful.
Aug 26 18:06:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6097158a-f767-4531-a6d4-d7ddfcd41c79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7876f8a9-1000-43ab-9e65-4996a17e03db]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== disconnect_volume: return (325ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:06:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Deleting instance files /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215_del
Aug 26 18:06:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Deletion of /opt/stack/data/nova/instances/e6aca42c-964c-4f78-b4c7-84457922c215_del complete
Aug 26 18:06:27 user nova-compute[73110]: INFO nova.compute.manager [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 18:06:27 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:06:27 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:06:28 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:28 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Took 0.80 seconds to deallocate network for instance.
Aug 26 18:06:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-a507f1e5-ed73-49d3-b0f5-e8ec8d41ef42 req-70e6fcd7-bb2d-4e95-8939-357a8ac09c35 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-deleted-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:28 user nova-compute[73110]: INFO nova.compute.manager [req-a507f1e5-ed73-49d3-b0f5-e8ec8d41ef42 req-70e6fcd7-bb2d-4e95-8939-357a8ac09c35 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Neutron deleted interface 363252b1-b8e9-4647-82d5-b112af68533d; detaching it from the instance and deleting it from the info cache
Aug 26 18:06:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-a507f1e5-ed73-49d3-b0f5-e8ec8d41ef42 req-70e6fcd7-bb2d-4e95-8939-357a8ac09c35 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-a507f1e5-ed73-49d3-b0f5-e8ec8d41ef42 req-70e6fcd7-bb2d-4e95-8939-357a8ac09c35 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Detach interface failed, port_id=363252b1-b8e9-4647-82d5-b112af68533d, reason: Instance e6aca42c-964c-4f78-b4c7-84457922c215 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] Acquiring lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] Lock "e6aca42c-964c-4f78-b4c7-84457922c215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] No waiting events found dispatching network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:29 user nova-compute[73110]: WARNING nova.compute.manager [req-b1abbf55-2e86-4781-ac0f-77b08028451b req-74f3405d-9ed4-4c26-be14-e9a64b81e8a4 service nova] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Received unexpected event network-vif-plugged-363252b1-b8e9-4647-82d5-b112af68533d for instance with vm_state active and task_state deleting.
Aug 26 18:06:29 user nova-compute[73110]: INFO nova.compute.manager [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Took 0.89 seconds to detach 1 volumes for instance.
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:06:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:29 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Deleted allocations for instance e6aca42c-964c-4f78-b4c7-84457922c215
Aug 26 18:06:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e9335050-7c41-4c7a-9204-96eec729e45f tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "e6aca42c-964c-4f78-b4c7-84457922c215" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:30 user nova-compute[73110]: INFO nova.compute.manager [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Took 7.97 seconds to detach 1 volumes for instance.
Aug 26 18:06:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Deleting volume: 977caf2f-8afb-4b5e-8147-64d6b8dc2de0 {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:06:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:31 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance d590856d-4739-4fc5-a2b9-d19f7526de4c
Aug 26 18:06:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca4f2f3-105c-4d2c-87c4-9feeef02abc1 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "d590856d-4739-4fc5-a2b9-d19f7526de4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.976s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:06:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:06:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:35 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073180.89865, d590856d-4739-4fc5-a2b9-d19f7526de4c => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:06:35 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] VM Stopped (Lifecycle Event)
Aug 26 18:06:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-4d7ba1be-c946-4051-99bb-ad01d149e01b None None] [instance: d590856d-4739-4fc5-a2b9-d19f7526de4c] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:42 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073187.3445845, e6aca42c-964c-4f78-b4c7-84457922c215 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:06:42 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] VM Stopped (Lifecycle Event)
Aug 26 18:06:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cf170327-a298-41a1-b19f-bd298ea84683 None None] [instance: e6aca42c-964c-4f78-b4c7-84457922c215] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:06:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:06:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:52 user nova-compute[73110]: INFO nova.compute.manager [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Terminating instance
Aug 26 18:06:52 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-e01ccad6-62d0-4ca8-9e60-86a4a2299c45 req-3f5d24b3-cf82-4b55-97b6-2febb0f7b155 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-unplugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Instance destroyed successfully.
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid 573d5b76-ace4-471a-a1d4-5a770389d14f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2123724910',display_name='tempest-ServerRescueNegativeTestJSON-server-2123724910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2123724910',id=24,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-y2ex1qea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:52:23Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=573d5b76-ace4-471a-a1d4-5a770389d14f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "e4282f7b-d25a-40b4-b583-108158205f46", "address": "fa:16:3e:16:dc:2b", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4282f7b-d2", "ovs_interfaceid": "e4282f7b-d25a-40b4-b583-108158205f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG os_vif [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4282f7b-d2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:06:53 user nova-compute[73110]: INFO os_vif [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:dc:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4282f7b-d25a-40b4-b583-108158205f46,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4282f7b-d2')
Aug 26 18:06:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Deleting instance files /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f_del
Aug 26 18:06:53 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Deletion of /opt/stack/data/nova/instances/573d5b76-ace4-471a-a1d4-5a770389d14f_del complete
Aug 26 18:06:53 user nova-compute[73110]: INFO nova.compute.manager [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 18:06:53 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:06:53 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:06:54 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:06:54 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Took 1.06 seconds to deallocate network for instance.
Aug 26 18:06:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:54 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:06:54 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:06:54 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:54 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Deleted allocations for instance 573d5b76-ace4-471a-a1d4-5a770389d14f
Aug 26 18:06:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5799469e-bf3d-4a73-b45e-89e36165b40b tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] Acquiring lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:06:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:06:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] Lock "573d5b76-ace4-471a-a1d4-5a770389d14f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:06:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] No waiting events found dispatching network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:06:55 user nova-compute[73110]: WARNING nova.compute.manager [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received unexpected event network-vif-plugged-e4282f7b-d25a-40b4-b583-108158205f46 for instance with vm_state deleted and task_state None.
Aug 26 18:06:55 user nova-compute[73110]: DEBUG nova.compute.manager [req-d1d446cc-2804-451a-b9d1-ebe4e4295948 req-a719c3d7-d562-4c79-98d9-a296ce27c837 service nova] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Received event network-vif-deleted-e4282f7b-d25a-40b4-b583-108158205f46 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:06:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 9020d47e-a37b-4695-9ab7-4c0c5563f958 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 512050ec-35e7-4bfa-8919-011f856986f4 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid aed0af97-da39-48c6-854b-16c80b679c19 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "512050ec-35e7-4bfa-8919-011f856986f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "aed0af97-da39-48c6-854b-16c80b679c19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "512050ec-35e7-4bfa-8919-011f856986f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "aed0af97-da39-48c6-854b-16c80b679c19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:06 user nova-compute[73110]: INFO nova.compute.manager [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Terminating instance
Aug 26 18:07:06 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-unplugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] No waiting events found dispatching network-vif-unplugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-d7af9bcc-95f3-46b2-801e-d8718bd2e6d3 req-b78069d0-bc40-4a9c-b311-9e057f412a0e service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-unplugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:07:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Instance destroyed successfully.
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lazy-loading 'resources' on Instance uuid aed0af97-da39-48c6-854b-16c80b679c19 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-730602915',display_name='tempest-VolumesActionsTest-instance-730602915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-730602915',id=43,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91abd0a8954494b86983642950796fd',ramdisk_id='',reservation_id='r-qcasjurv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-38073166',owner_user_name='tempest-VolumesActionsTest-38073166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:05:23Z,user_data=None,user_id='64ac81964ee54d3296747f0a389aeacf',uuid=aed0af97-da39-48c6-854b-16c80b679c19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converting VIF {"id": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "address": "fa:16:3e:75:5d:b3", "network": {"id": "4ada35df-c260-446e-bd0b-6402de174ba3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909829424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91abd0a8954494b86983642950796fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d21ef0d-2d", "ovs_interfaceid": "6d21ef0d-2da8-41aa-91d4-dec5f5668c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG os_vif [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d21ef0d-2d, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:07 user nova-compute[73110]: INFO os_vif [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5d:b3,bridge_name='br-int',has_traffic_filtering=True,id=6d21ef0d-2da8-41aa-91d4-dec5f5668c9a,network=Network(4ada35df-c260-446e-bd0b-6402de174ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d21ef0d-2d')
Aug 26 18:07:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Deleting instance files /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19_del
Aug 26 18:07:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Deletion of /opt/stack/data/nova/instances/aed0af97-da39-48c6-854b-16c80b679c19_del complete
Aug 26 18:07:07 user nova-compute[73110]: INFO nova.compute.manager [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 26 18:07:07 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:07:07 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:08 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Took 0.57 seconds to deallocate network for instance.
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-6bb25839-cd9e-46d0-8df0-245e7e30ca73 req-3f5c536f-6342-4956-a78e-0ac5b09b1805 service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-deleted-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073213.4014657, 573d5b76-ace4-471a-a1d4-5a770389d14f => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:07:08 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] VM Stopped (Lifecycle Event)
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ec6c4ed4-b327-4ac6-9934-ce22efb1793c None None] [instance: 573d5b76-ace4-471a-a1d4-5a770389d14f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:07:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:08 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Deleted allocations for instance aed0af97-da39-48c6-854b-16c80b679c19
Aug 26 18:07:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7be1ab20-3822-4149-b5e1-f356c9963390 tempest-VolumesActionsTest-38073166 tempest-VolumesActionsTest-38073166-project-member] Lock "aed0af97-da39-48c6-854b-16c80b679c19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.762s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] Acquiring lock "aed0af97-da39-48c6-854b-16c80b679c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] Lock "aed0af97-da39-48c6-854b-16c80b679c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] No waiting events found dispatching network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:09 user nova-compute[73110]: WARNING nova.compute.manager [req-f2075fe9-b9dc-4150-a8b7-8f0de4398d9c req-e2cfb421-d124-41c9-a602-ec94a379296a service nova] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Received unexpected event network-vif-plugged-6d21ef0d-2da8-41aa-91d4-dec5f5668c9a for instance with vm_state deleted and task_state None.
Aug 26 18:07:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:10 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:07:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:14 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [{"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-a2a92241-07a2-43d9-aceb-98fc7f81fc8d" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:16 user nova-compute[73110]: INFO nova.compute.manager [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Terminating instance
Aug 26 18:07:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-unplugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] No waiting events found dispatching network-vif-unplugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-300a52ec-bf5f-41d9-9370-1ccd54f6325a req-89fbc316-d2e2-484f-9ba0-7734923a0527 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-unplugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:17 user nova-compute[73110]: INFO nova.compute.manager [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Terminating instance
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Instance destroyed successfully.
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.objects.instance [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid 512050ec-35e7-4bfa-8919-011f856986f4 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133146417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133146417',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ1EMNzTSB/d9C3QgjxZ8AAl05FUKEdieNyxMR8hjJWf5fzVYVltP1OAgrdNZqNjCOjEJIgXDCFrUCbMF9EmAMrlgHHQv5ffXWeP3Ap647LAqq+nsOh36P7+iM7xxb7Kg==',key_name='tempest-keypair-853239979',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-wjx8ir2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=512050ec-35e7-4bfa-8919-011f856986f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "address": "fa:16:3e:17:23:fa", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape386a95d-8e", "ovs_interfaceid": "e386a95d-8e3e-40d7-a44a-ddebbb661912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_vif [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape386a95d-8e, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:17 user nova-compute[73110]: INFO os_vif [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:23:fa,bridge_name='br-int',has_traffic_filtering=True,id=e386a95d-8e3e-40d7-a44a-ddebbb661912,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape386a95d-8e')
Aug 26 18:07:17 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAWJZNfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:07:17 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09c6493-7b04-4a7b-baf7-9679298b0701]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0687a-9b46-4ff7-9bbb-c5e5f41b321a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:07:17 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:07:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:07:17 user nova-compute[73110]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 (non-flash)
Aug 26 18:07:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e249d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[407306a5-ce4f-4dbb-b675-790ab33a50c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d87cd-1d28-4904-8f53-f4c7a44d262f]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60ce1f-1e7b-4a6a-a7f2-4e22a4a3b69f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:07:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75712bf-e740-4c01-992a-64bad89bf2b9]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e993b-5788-4eb0-bfdc-c036d1ce5a7a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-unplugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] No waiting events found dispatching network-vif-unplugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-0f2210ae-650b-4e63-bd5d-00e1b0729ce4 req-2a72a90b-b2eb-44b0-aeb0-6cc526267755 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-unplugged-c9d8efc4-a60e-4163-b032-c289faf17cef for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea9401-f9fe-4fae-b7eb-f7331a05feef]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260]
Aug 26 18:07:18 user nova-compute[73110]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:07:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb815c35-b127-47ed-b95b-4122f84a17c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af23932-1464-4ecf-be68-650a9a7fc719]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (287ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Deleting instance files /opt/stack/data/nova/instances/512050ec-35e7-4bfa-8919-011f856986f4_del
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Deletion of /opt/stack/data/nova/instances/512050ec-35e7-4bfa-8919-011f856986f4_del complete
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.compute.manager [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Instance destroyed successfully.
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid 9020d47e-a37b-4695-9ab7-4c0c5563f958 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494624125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494624125',id=34,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-we0nrrdt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:59:52Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=9020d47e-a37b-4695-9ab7-4c0c5563f958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c9d8efc4-a60e-4163-b032-c289faf17cef", "address": "fa:16:3e:7b:b9:ff", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d8efc4-a6", "ovs_interfaceid": "c9d8efc4-a60e-4163-b032-c289faf17cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG os_vif [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d8efc4-a6, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:18 user nova-compute[73110]: INFO os_vif [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=c9d8efc4-a60e-4163-b032-c289faf17cef,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d8efc4-a6')
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Deleting instance files /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958_del
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Deletion of /opt/stack/data/nova/instances/9020d47e-a37b-4695-9ab7-4c0c5563f958_del complete
Aug 26 18:07:18 user nova-compute[73110]: INFO nova.compute.manager [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:19 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid '9020d47e-a37b-4695-9ab7-4c0c5563f958' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid '9020d47e-a37b-4695-9ab7-4c0c5563f958' (instance-00000022)
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:19 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Took 0.77 seconds to deallocate network for instance.
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-a457b6ec-d55c-4819-badb-102725cd7b37 req-0df473ad-706d-4e74-bfc7-0dfb96df0c95 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-deleted-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:19 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Took 0.96 seconds to deallocate network for instance.
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] Acquiring lock "512050ec-35e7-4bfa-8919-011f856986f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] Lock "512050ec-35e7-4bfa-8919-011f856986f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] No waiting events found dispatching network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:19 user nova-compute[73110]: WARNING nova.compute.manager [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received unexpected event network-vif-plugged-e386a95d-8e3e-40d7-a44a-ddebbb661912 for instance with vm_state active and task_state deleting.
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.compute.manager [req-9d2d0c47-4f21-47be-8d76-3cb377e66316 req-a0e054ea-26e1-467c-981f-23d05c256bb4 service nova] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Received event network-vif-deleted-e386a95d-8e3e-40d7-a44a-ddebbb661912 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:07:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:19 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Deleted allocations for instance 9020d47e-a37b-4695-9ab7-4c0c5563f958
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a587bd5c-21b7-4119-8eb6-5397c11393ad tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.410s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] Acquiring lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] Lock "9020d47e-a37b-4695-9ab7-4c0c5563f958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] No waiting events found dispatching network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:20 user nova-compute[73110]: WARNING nova.compute.manager [req-784ed2a6-0dc7-44f5-a550-a22174a16ccc req-c9edf7f3-d219-4553-ac62-d90c516c7b47 service nova] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Received unexpected event network-vif-plugged-c9d8efc4-a60e-4163-b032-c289faf17cef for instance with vm_state deleted and task_state None.
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:07:20 user nova-compute[73110]: INFO nova.compute.manager [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Deleting volume: eb815c35-b127-47ed-b95b-4122f84a17c7 {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:07:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:07:20 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8190MB free_disk=24.945655822753906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance d7c5e50e-1035-438b-82c0-946cb4c36547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 512050ec-35e7-4bfa-8919-011f856986f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:07:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:07:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:21 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance 512050ec-35e7-4bfa-8919-011f856986f4
Aug 26 18:07:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28daf2a0-ca5c-4055-a73d-2fbc2f8357f4 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "512050ec-35e7-4bfa-8919-011f856986f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.486s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:22 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073227.5439842, aed0af97-da39-48c6-854b-16c80b679c19 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:07:22 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: aed0af97-da39-48c6-854b-16c80b679c19] VM Stopped (Lifecycle Event)
Aug 26 18:07:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-c255839b-330a-48e4-9853-2f6cfec7f66b None None] [instance: aed0af97-da39-48c6-854b-16c80b679c19] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:07:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:07:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:32 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073237.8232596, 512050ec-35e7-4bfa-8919-011f856986f4 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:07:32 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] VM Stopped (Lifecycle Event)
Aug 26 18:07:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b87454af-5478-4883-a952-3ffd26ead033 None None] [instance: 512050ec-35e7-4bfa-8919-011f856986f4] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:07:33 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073238.524145, 9020d47e-a37b-4695-9ab7-4c0c5563f958 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:07:33 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] VM Stopped (Lifecycle Event)
Aug 26 18:07:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-c4b58143-2e64-44e6-9589-305d5584859e None None] [instance: 9020d47e-a37b-4695-9ab7-4c0c5563f958] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:07:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:43 user nova-compute[73110]: INFO nova.compute.manager [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Terminating instance
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.compute.manager [req-3b8169e8-8dc7-49cd-b369-14580c75bdb4 req-5f54a374-28d6-4f05-8192-ffd91ad6beff service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-unplugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Instance destroyed successfully.
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lazy-loading 'resources' on Instance uuid d7c5e50e-1035-438b-82c0-946cb4c36547 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-326749718',display_name='tempest-ServerRescueNegativeTestJSON-server-326749718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-326749718',id=23,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:55:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5fcf35a12ef444b87aff6fa79bff21a',ramdisk_id='',reservation_id='r-2ni9c1a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1378027755',owner_user_name='tempest-ServerRescueNegativeTestJSON-1378027755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:57:08Z,user_data=None,user_id='4a8aa997bb214e5f9aa5fd0badb394be',uuid=d7c5e50e-1035-438b-82c0-946cb4c36547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converting VIF {"id": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "address": "fa:16:3e:62:9f:6c", "network": {"id": "a7349c0b-06aa-4f72-969a-e96dd0a998b4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977517650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5fcf35a12ef444b87aff6fa79bff21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4dfc55-0f", "ovs_interfaceid": "4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG os_vif [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c4dfc55-0f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:43 user nova-compute[73110]: INFO os_vif [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:9f:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d,network=Network(a7349c0b-06aa-4f72-969a-e96dd0a998b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4dfc55-0f')
Aug 26 18:07:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Deleting instance files /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547_del
Aug 26 18:07:43 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Deletion of /opt/stack/data/nova/instances/d7c5e50e-1035-438b-82c0-946cb4c36547_del complete
Aug 26 18:07:43 user nova-compute[73110]: INFO nova.compute.manager [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 18:07:43 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:07:43 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:44 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Took 0.45 seconds to deallocate network for instance.
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-f462f9a4-55ad-453f-ac1c-f101a17c6d0e req-f3f3cba4-e119-4425-90ff-8287986aa4a9 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-deleted-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:44 user nova-compute[73110]: INFO nova.compute.manager [req-f462f9a4-55ad-453f-ac1c-f101a17c6d0e req-f3f3cba4-e119-4425-90ff-8287986aa4a9 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Neutron deleted interface 4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d; detaching it from the instance and deleting it from the info cache
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.network.neutron [req-f462f9a4-55ad-453f-ac1c-f101a17c6d0e req-f3f3cba4-e119-4425-90ff-8287986aa4a9 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-f462f9a4-55ad-453f-ac1c-f101a17c6d0e req-f3f3cba4-e119-4425-90ff-8287986aa4a9 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Detach interface failed, port_id=4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d, reason: Instance d7c5e50e-1035-438b-82c0-946cb4c36547 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:07:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:44 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Deleted allocations for instance d7c5e50e-1035-438b-82c0-946cb4c36547
Aug 26 18:07:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ef33fb48-1b1f-478d-98e2-536fc841b2a9 tempest-ServerRescueNegativeTestJSON-1378027755 tempest-ServerRescueNegativeTestJSON-1378027755-project-member] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:07:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] Acquiring lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:07:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:07:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] Lock "d7c5e50e-1035-438b-82c0-946cb4c36547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:07:45 user nova-compute[73110]: DEBUG nova.compute.manager [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] No waiting events found dispatching network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:07:45 user nova-compute[73110]: WARNING nova.compute.manager [req-c20ddfd6-9c71-4e24-9481-f7aea8033347 req-a03cb808-bf77-4246-ba48-ba18b1a12385 service nova] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Received unexpected event network-vif-plugged-4c4dfc55-0ff6-4f88-9f9a-79addb5ad77d for instance with vm_state deleted and task_state None.
Aug 26 18:07:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073263.8607225, d7c5e50e-1035-438b-82c0-946cb4c36547 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:07:58 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] VM Stopped (Lifecycle Event)
Aug 26 18:07:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-120ce05e-c72a-40ca-b67d-24032891e239 None None] [instance: d7c5e50e-1035-438b-82c0-946cb4c36547] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:07:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-changed-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing instance network info cache due to event network-changed-2ea934be-c527-4731-a794-d1ecd160d126. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] Acquiring lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] Acquired lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing network info cache for port 2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:08:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updated VIF entry in instance network info cache for port 2ea934be-c527-4731-a794-d1ecd160d126. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [{"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a37febe9-f04d-4872-b113-ac49e0fe9a71 req-dba7bc8f-bead-472a-99fa-1067289bc5a3 service nova] Releasing lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:04 user nova-compute[73110]: INFO nova.compute.manager [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Attaching volume 09978c09-1ddc-469f-ae4f-f780a6d1f2ff to /dev/vdb
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.utils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54a27f7-39a4-4c2a-bea4-8b1b8dc2640e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[12361491-f626-4f5f-ae04-4e30b1377980]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c67dff8-6462-4db1-9208-4601247a6484]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e0e86-c529-4873-9d73-e58e014033ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:08:04 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:08:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f359de-03d4-423a-945b-d6cdaa64e25b]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG os_brick.utils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating existing volume attachment record: 5d275517-d771-4dee-9144-1bb20a6f62cf {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:08:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:08 user nova-compute[73110]: INFO nova.compute.manager [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Terminating instance
Aug 26 18:08:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-6820bc51-e29e-4f64-8d09-0b4b49011586 req-e0bcc25f-c44f-4a98-b64e-d9696dbd63da service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-unplugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Instance destroyed successfully.
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid 524fef5b-abfb-4d7d-b14f-eb899fa526d2 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488928143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488928143',id=30,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-n0nsdvz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:56:08Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=524fef5b-abfb-4d7d-b14f-eb899fa526d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "address": "fa:16:3e:49:d4:01", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb298fd-da", "ovs_interfaceid": "1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_vif [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb298fd-da, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:08:09 user nova-compute[73110]: INFO os_vif [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d4:01,bridge_name='br-int',has_traffic_filtering=True,id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb298fd-da')
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCQplWMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:09 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3602db02-46a7-4265-8c0e-f7b75df91846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe54777-eafd-4853-9daf-71d16074a65a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:08:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 (non-flash)
Aug 26 18:08:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544113be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ca29e-2dcc-4c44-a1dd-91463a83fd53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb306a7-70f7-438c-898f-72afabdcf437]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792078f-a587-4bbd-992a-9785cfefcd5d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671ae7b-d729-4480-bdad-265988c376f3]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bbc8c1-e1e5-425b-b940-25d6b39377d7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0b60f-376e-4135-bd4a-e02a2b8b6281]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260]
Aug 26 18:08:09 user nova-compute[73110]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41, portal: 172.16.0.220,3260] successful.
Aug 26 18:08:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a32866a6-0913-4afc-abf4-90953ea46e41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d301f3-4d4c-4b1e-b75e-6af35489c123]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] <== disconnect_volume: return (282ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:08:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Deleting instance files /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2_del
Aug 26 18:08:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Deletion of /opt/stack/data/nova/instances/524fef5b-abfb-4d7d-b14f-eb899fa526d2_del complete
Aug 26 18:08:09 user nova-compute[73110]: INFO nova.compute.manager [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 26 18:08:09 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:08:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:10 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Took 0.61 seconds to deallocate network for instance.
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-845b3b4d-cb07-4a75-8bf7-2ad16a409af1 req-fb811ba3-d29b-4d70-9f87-6f1739de67ff service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-deleted-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:10 user nova-compute[73110]: INFO nova.compute.manager [req-845b3b4d-cb07-4a75-8bf7-2ad16a409af1 req-fb811ba3-d29b-4d70-9f87-6f1739de67ff service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Neutron deleted interface 1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b; detaching it from the instance and deleting it from the info cache
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.network.neutron [req-845b3b4d-cb07-4a75-8bf7-2ad16a409af1 req-fb811ba3-d29b-4d70-9f87-6f1739de67ff service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-845b3b4d-cb07-4a75-8bf7-2ad16a409af1 req-fb811ba3-d29b-4d70-9f87-6f1739de67ff service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Detach interface failed, port_id=1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b, reason: Instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] Acquiring lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG nova.compute.manager [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] No waiting events found dispatching network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:08:10 user nova-compute[73110]: WARNING nova.compute.manager [req-1f1d3354-64ca-4187-9cd9-a26b630dc460 req-764391db-5aab-49cc-bd73-624b4a95c1cc service nova] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Received unexpected event network-vif-plugged-1cb298fd-dae3-4b0a-a0f3-a04d9ae9b05b for instance with vm_state active and task_state deleting.
Aug 26 18:08:10 user nova-compute[73110]: INFO nova.compute.manager [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 18:08:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:11 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Deleted allocations for instance 524fef5b-abfb-4d7d-b14f-eb899fa526d2
Aug 26 18:08:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:08:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e89c2e0a-b892-4361-abf0-4b1929607c14 tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "524fef5b-abfb-4d7d-b14f-eb899fa526d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:12 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdMkLZXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:16 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:16 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:16 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c8704-6494-4ab3-833b-9eed5b0fb696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:08:16 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432a7f4-4a83-4f22-9f8c-7a9b04395dec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff] added
Aug 26 18:08:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6b8f7-3669-4702-af8c-ba3907c63558]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c54a76-969d-4303-a5ff-8cfe88c119e4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdMkLZXj {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdMkLZXj" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcad7ba-7ba5-4eb6-9627-cd6e07e44f10]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PdMkLZXj'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c39383-1815-4e2d-a851-3883c8f785ae]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e733bb-31e5-4cea-be59-83474b68e70f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:16 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:16 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --login" returned: 0 in 1.057s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b6322-a33a-4d4c-a73b-46692099b725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260]
Aug 26 18:08:17 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260] successful.
Aug 26 18:08:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[93747c7a-e31b-43b1-a84d-201a2e18704d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e1ff0-c47b-4f19-8b47-a9280977acbe]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:17 user nova-compute[73110]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)
Aug 26 18:08:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:17 user nova-compute[73110]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)
Aug 26 18:08:17 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.304s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe4239-39d2-4e90-8b17-418ac7c95651]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:17 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdMkLZXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.346s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== connect_volume: return (2348ms) {'type': 'block', 'scsi_wwn': '23263373265643538', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263373265643538', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:08:18 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:08:18 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:08:18 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:08:18 user nova-compute[73110]:   <serial>09978c09-1ddc-469f-ae4f-f780a6d1f2ff</serial>
Aug 26 18:08:18 user nova-compute[73110]: </disk>
Aug 26 18:08:18 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] No VIF found with MAC fa:16:3e:fa:f4:ed, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-03222d6c-e416-4296-b96f-adf4e5051922 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.859s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:08:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:23 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:08:23 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=24.488937377929688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:23 user nova-compute[73110]: INFO nova.compute.manager [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Detaching volume 09978c09-1ddc-469f-ae4f-f780a6d1f2ff
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:08:23 user nova-compute[73110]: INFO nova.virt.block_device [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Attempting to driver detach volume 09978c09-1ddc-469f-ae4f-f780a6d1f2ff from mountpoint /dev/vdb
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Attempting to detach device vdb from instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:08:23 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:08:23 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:08:23 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:08:23 user nova-compute[73110]:   <serial>09978c09-1ddc-469f-ae4f-f780a6d1f2ff</serial>
Aug 26 18:08:23 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:08:23 user nova-compute[73110]: </disk>
Aug 26 18:08:23 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:08:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully detached device vdb from instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 from the persistent domain config.
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:08:23 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:08:23 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:08:23 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:08:23 user nova-compute[73110]:   <serial>09978c09-1ddc-469f-ae4f-f780a6d1f2ff</serial>
Aug 26 18:08:23 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:08:23 user nova-compute[73110]: </disk>
Aug 26 18:08:23 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:08:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073289.053559, 524fef5b-abfb-4d7d-b14f-eb899fa526d2 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:08:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] VM Stopped (Lifecycle Event)
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073304.0612721, 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:08:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully detached device vdb from instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 from the live domain config.
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdMkLZXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-57e9bf8f-89dd-406f-b3b6-9c67126d1d51 None None] [instance: 524fef5b-abfb-4d7d-b14f-eb899fa526d2] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a002970-d0d4-4d08-8af7-b5bb750c6f04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f2d3d0-0441-4420-a082-0d8026fe7a42]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:24 user nova-compute[73110]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)
Aug 26 18:08:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc499dd-2333-4fa7-809a-464cdfce039f (non-flash)
Aug 26 18:08:24 user nova-compute[73110]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff (non-flash)
Aug 26 18:08:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd544113d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f634640d-599f-4385-befd-02d0214cdbbd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f3f45-4a08-4bb9-a2f9-28b6341dfb78]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a72447-6d90-4252-a9ed-a231f550d538]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2c6a2-00f3-4a7a-8e8b-dbbb102236bd]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.093s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e466b2bc-f330-43cc-9815-e7d74ac73143]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.189s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c13aed-6151-440c-8171-6429724eb384]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260]
Aug 26 18:08:24 user nova-compute[73110]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff, portal: 172.16.0.220,3260] successful.
Aug 26 18:08:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09978c09-1ddc-469f-ae4f-f780a6d1f2ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6574e7-830b-4b4c-9059-f1ea3f6e627e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] <== disconnect_volume: return (559ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:08:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:08:25 user nova-compute[73110]: INFO nova.compute.claims [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Claim successful on node user
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'flavor' on Instance uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d5470d69-6aea-4f84-b205-fe71e4b54110 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.152s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:08:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:08:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:08:26 user nova-compute[73110]: INFO nova.virt.block_device [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Booting with volume ba48cdfb-a8b5-4603-b77e-36e1a07e2347 at /dev/vda
Aug 26 18:08:26 user nova-compute[73110]: DEBUG nova.policy [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.utils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef7057-3e6f-4d9c-b20c-2ce9481ca870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1de94b-cd3b-4c8d-a819-886064349f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df0116b-8b8d-48ce-b907-db05d23a4eb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd23b9e-4bf0-4abf-aa5e-d9e640842e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:08:26 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:08:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb1d5f-7c07-46f9-83c0-15d9fec24d80]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG os_brick.utils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:26 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating existing volume attachment record: 6a10b763-4633-45dc-be24-f4f2e1ab653a {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:08:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Successfully created port: 7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Successfully updated port: 7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-changed-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Refreshing instance network info cache due to event network-changed-7775a461-4a9d-4bd0-83d8-d0e51c87a977. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] Acquiring lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating instance_info_cache with network_info: [{"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Instance network_info: |[{"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] Acquired lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:08:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Refreshing network info cache for port 7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updated VIF entry in instance network info cache for port 7775a461-4a9d-4bd0-83d8-d0e51c87a977. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG nova.network.neutron [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating instance_info_cache with network_info: [{"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-588a1ee4-bbf1-46c5-9f11-74042843f096 req-09d0b98f-bd80-45dc-a7cb-0669ab9ab81e service nova] Releasing lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:08:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:08:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Creating image(s)
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Ensure instance console log exists: /opt/stack/data/nova/instances/97196ae9-ebea-49a8-ab2e-2d094548922f/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Start _get_guest_xml network_info=[{"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6a10b763-4633-45dc-be24-f4f2e1ab653a', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97196ae9-ebea-49a8-ab2e-2d094548922f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba48cdfb-a8b5-4603-b77e-36e1a07e2347', 'serial': 'ba48cdfb-a8b5-4603-b77e-36e1a07e2347'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:08:37 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:08:37 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:08:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:08:37 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[85491202-e9b1-4b53-943f-0b6897e059dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:08:37 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1aec08-6b18-4603-8778-5de16ae4cea6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347] added
Aug 26 18:08:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[436229b3-20e6-4ec9-aa7f-88873f57479a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8fb8b-377e-4b23-9421-68e50d69aa16]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RESmxeas {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RESmxeas" returned: 0 in 0.036s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8c38be-8617-4afa-ae92-e8e7992b516e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RESmxeas'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d109c6-b3d3-4c2d-a7e7-1970a51df558]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716cf6c-4631-4871-abe6-1c90ce4f5ce4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:08:37 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:08:37 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:37 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:08:37 user nova-compute[73110]: 
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[404838e9-4043-414d-a47f-ad4db51222cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]
Aug 26 18:08:37 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.
Aug 26 18:08:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c813fdd-8d2e-4717-b357-50c9e31f32f2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f22c0-1b10-4d25-9906-d826be9d98fb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:08:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:08:37 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d8130e-7d19-4d56-8f66-f688723b579e]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:08:37 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26230646665386537', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230646665386537', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066545695',display_name='tempest-TestVolumeBootPattern-server-1066545695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066545695',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-g7gkhwvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:08:26Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=97196ae9-ebea-49a8-ab2e-2d094548922f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid 97196ae9-ebea-49a8-ab2e-2d094548922f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:08:38 user nova-compute[73110]:   <uuid>97196ae9-ebea-49a8-ab2e-2d094548922f</uuid>
Aug 26 18:08:38 user nova-compute[73110]:   <name>instance-0000002d</name>
Aug 26 18:08:38 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:08:38 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:08:38 user nova-compute[73110]:   <metadata>
Aug 26 18:08:38 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:08:38 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:08:38 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-server-1066545695</nova:name>
Aug 26 18:08:38 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:08:37</nova:creationTime>
Aug 26 18:08:38 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:08:38 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:08:38 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:08:38 user nova-compute[73110]:       <nova:owner>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 18:08:38 user nova-compute[73110]:       </nova:owner>
Aug 26 18:08:38 user nova-compute[73110]:       <nova:ports>
Aug 26 18:08:38 user nova-compute[73110]:         <nova:port uuid="7775a461-4a9d-4bd0-83d8-d0e51c87a977">
Aug 26 18:08:38 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 18:08:38 user nova-compute[73110]:         </nova:port>
Aug 26 18:08:38 user nova-compute[73110]:       </nova:ports>
Aug 26 18:08:38 user nova-compute[73110]:     </nova:instance>
Aug 26 18:08:38 user nova-compute[73110]:   </metadata>
Aug 26 18:08:38 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:08:38 user nova-compute[73110]:     <system>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="serial">97196ae9-ebea-49a8-ab2e-2d094548922f</entry>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="uuid">97196ae9-ebea-49a8-ab2e-2d094548922f</entry>
Aug 26 18:08:38 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:08:38 user nova-compute[73110]:     </system>
Aug 26 18:08:38 user nova-compute[73110]:   </sysinfo>
Aug 26 18:08:38 user nova-compute[73110]:   <os>
Aug 26 18:08:38 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:08:38 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:08:38 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:08:38 user nova-compute[73110]:   </os>
Aug 26 18:08:38 user nova-compute[73110]:   <features>
Aug 26 18:08:38 user nova-compute[73110]:     <acpi/>
Aug 26 18:08:38 user nova-compute[73110]:     <apic/>
Aug 26 18:08:38 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:08:38 user nova-compute[73110]:   </features>
Aug 26 18:08:38 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:08:38 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:08:38 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:08:38 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:08:38 user nova-compute[73110]:   </clock>
Aug 26 18:08:38 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:08:38 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:08:38 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:08:38 user nova-compute[73110]:   </cpu>
Aug 26 18:08:38 user nova-compute[73110]:   <devices>
Aug 26 18:08:38 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:08:38 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:08:38 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 18:08:38 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:08:38 user nova-compute[73110]:       <serial>ba48cdfb-a8b5-4603-b77e-36e1a07e2347</serial>
Aug 26 18:08:38 user nova-compute[73110]:     </disk>
Aug 26 18:08:38 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:08:38 user nova-compute[73110]:       <mac address="fa:16:3e:c5:08:b8"/>
Aug 26 18:08:38 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:08:38 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:08:38 user nova-compute[73110]:       <target dev="tap7775a461-4a"/>
Aug 26 18:08:38 user nova-compute[73110]:     </interface>
Aug 26 18:08:38 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:08:38 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/97196ae9-ebea-49a8-ab2e-2d094548922f/console.log" append="off"/>
Aug 26 18:08:38 user nova-compute[73110]:     </serial>
Aug 26 18:08:38 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:08:38 user nova-compute[73110]:     <video>
Aug 26 18:08:38 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:08:38 user nova-compute[73110]:     </video>
Aug 26 18:08:38 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:08:38 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:08:38 user nova-compute[73110]:     </rng>
Aug 26 18:08:38 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:08:38 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:08:38 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:08:38 user nova-compute[73110]:     </memballoon>
Aug 26 18:08:38 user nova-compute[73110]:   </devices>
Aug 26 18:08:38 user nova-compute[73110]: </domain>
Aug 26 18:08:38 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066545695',display_name='tempest-TestVolumeBootPattern-server-1066545695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066545695',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-g7gkhwvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:08:26Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=97196ae9-ebea-49a8-ab2e-2d094548922f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG os_vif [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7775a461-4a, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7775a461-4a, col_values=(('external_ids', {'iface-id': '7775a461-4a9d-4bd0-83d8-d0e51c87a977', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:08:b8', 'vm-uuid': '97196ae9-ebea-49a8-ab2e-2d094548922f'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:38 user nova-compute[73110]: INFO os_vif [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a')
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:08:38 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:c5:08:b8, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG nova.compute.manager [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] No waiting events found dispatching network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:08:40 user nova-compute[73110]: WARNING nova.compute.manager [req-79c08ca3-3840-4449-8085-f509cae7bb99 req-f5ea6126-777c-43a6-add6-7c303ac1da64 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received unexpected event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 for instance with vm_state building and task_state spawning.
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] No waiting events found dispatching network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:08:42 user nova-compute[73110]: WARNING nova.compute.manager [req-eeb07068-0515-492a-ba16-b6af6425b8e1 req-655c04f6-82b0-4265-be96-e918560e809d service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received unexpected event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 for instance with vm_state building and task_state spawning.
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073322.6399143, 97196ae9-ebea-49a8-ab2e-2d094548922f => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] VM Resumed (Lifecycle Event)
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Instance spawned successfully.
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073322.6413276, 97196ae9-ebea-49a8-ab2e-2d094548922f => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] VM Started (Lifecycle Event)
Aug 26 18:08:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 26 18:08:42 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:08:42 user nova-compute[73110]: INFO nova.compute.manager [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Took 17.39 seconds to build instance.
Aug 26 18:08:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d4ae003f-deeb-4843-bc49-1c2c0db24036 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.500s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:08:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Terminating instance
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-unplugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-unplugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.compute.manager [req-46022d74-5305-4730-99b5-82c0216a92d3 req-55d24048-81ec-4a8a-96dd-a3fce1ecf450 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-unplugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Instance destroyed successfully.
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lazy-loading 'resources' on Instance uuid a2a92241-07a2-43d9-aceb-98fc7f81fc8d {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-518157684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-518157684',id=21,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef6ddc676bd48e4886079097e3e0d7a',ramdisk_id='',reservation_id='r-g7xkk2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:51:18Z,user_data=None,user_id='095465fef30b4fd0a144cb5b7c4ffb7d',uuid=a2a92241-07a2-43d9-aceb-98fc7f81fc8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converting VIF {"id": "c5495262-75f5-4825-920f-72bd07c29452", "address": "fa:16:3e:c9:ed:ea", "network": {"id": "b37e1a58-5906-4c29-bf27-6d47c76131f2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-741332243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef6ddc676bd48e4886079097e3e0d7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5495262-75", "ovs_interfaceid": "c5495262-75f5-4825-920f-72bd07c29452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG os_vif [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5495262-75, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:08:59 user nova-compute[73110]: INFO os_vif [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ed:ea,bridge_name='br-int',has_traffic_filtering=True,id=c5495262-75f5-4825-920f-72bd07c29452,network=Network(b37e1a58-5906-4c29-bf27-6d47c76131f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5495262-75')
Aug 26 18:08:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Deleting instance files /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d_del
Aug 26 18:08:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Deletion of /opt/stack/data/nova/instances/a2a92241-07a2-43d9-aceb-98fc7f81fc8d_del complete
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:08:59 user nova-compute[73110]: INFO nova.compute.manager [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 26 18:08:59 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:08:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:09:00 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Took 0.55 seconds to deallocate network for instance.
Aug 26 18:09:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-5cfe75f1-5d7b-41a9-b52b-61168b4b0dfc req-770df5c6-156c-4115-bb0a-326f15f7800e service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-deleted-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:09:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:00 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Deleted allocations for instance a2a92241-07a2-43d9-aceb-98fc7f81fc8d
Aug 26 18:09:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ed9f1b73-b18e-4e1f-914d-122bd41871ba tempest-ServerBootFromVolumeStableRescueTest-1304505303 tempest-ServerBootFromVolumeStableRescueTest-1304505303-project-member] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:01 user nova-compute[73110]: WARNING nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state deleted and task_state None.
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:01 user nova-compute[73110]: WARNING nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state deleted and task_state None.
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:01 user nova-compute[73110]: WARNING nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state deleted and task_state None.
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Acquiring lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] Lock "a2a92241-07a2-43d9-aceb-98fc7f81fc8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:01 user nova-compute[73110]: DEBUG nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] No waiting events found dispatching network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:01 user nova-compute[73110]: WARNING nova.compute.manager [req-293f135d-20a2-434e-9d1c-5258c4778187 req-adfdd6c2-a8e9-4f7b-a3d4-777c8847e667 service nova] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Received unexpected event network-vif-plugged-c5495262-75f5-4825-920f-72bd07c29452 for instance with vm_state deleted and task_state None.
Aug 26 18:09:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-changed-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing instance network info cache due to event network-changed-2ea934be-c527-4731-a794-d1ecd160d126. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] Acquiring lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] Acquired lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Refreshing network info cache for port 2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:13 user nova-compute[73110]: INFO nova.compute.manager [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Terminating instance
Aug 26 18:09:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-unplugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] No waiting events found dispatching network-vif-unplugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-335fa201-5ed1-4d83-aa17-b38df430691c req-b5439d74-47ae-4851-ae61-a6dcae8effc9 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-unplugged-2ea934be-c527-4731-a794-d1ecd160d126 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updated VIF entry in instance network info cache for port 2ea934be-c527-4731-a794-d1ecd160d126. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [{"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-62b9666c-b806-4810-b1d6-099285b7081d req-72b48f0f-0b20-47fb-b152-40c447f21d27 service nova] Releasing lock "refresh_cache-3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Instance destroyed successfully.
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'resources' on Instance uuid 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-599720899',display_name='tempest-TestStampPattern-server-599720899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-599720899',id=44,image_ref='aa8b48d0-6056-4d51-a85a-0e81cbdaf925',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-bgtstoo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1d17f7fc-88c5-4270-9249-52dbe3d9354a',image_min_disk='1',image_min_ram='0',image_owner_id='205df4d98cf24ae48843664efb353420',image_owner_project_name='tempest-TestStampPattern-277351961',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277351961-project-member',image_user_id='62e166fb79ac46669ca6580d0bb1b6eb',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:06:19Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "2ea934be-c527-4731-a794-d1ecd160d126", "address": "fa:16:3e:fa:f4:ed", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea934be-c5", "ovs_interfaceid": "2ea934be-c527-4731-a794-d1ecd160d126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG os_vif [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea934be-c5, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:14 user nova-compute[73110]: INFO os_vif [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f4:ed,bridge_name='br-int',has_traffic_filtering=True,id=2ea934be-c527-4731-a794-d1ecd160d126,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea934be-c5')
Aug 26 18:09:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Deleting instance files /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0_del
Aug 26 18:09:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Deletion of /opt/stack/data/nova/instances/3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0_del complete
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073339.7516823, a2a92241-07a2-43d9-aceb-98fc7f81fc8d => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:09:14 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] VM Stopped (Lifecycle Event)
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7159a856-a269-489d-8f2a-e84fe1d023cd None None] [instance: a2a92241-07a2-43d9-aceb-98fc7f81fc8d] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:09:14 user nova-compute[73110]: INFO nova.compute.manager [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 18:09:14 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:09:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-a16b496f-6835-47ac-843c-335d57289cbe req-199e3452-1228-4fc7-bfed-0912922b9c48 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-deleted-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:15 user nova-compute[73110]: INFO nova.compute.manager [req-a16b496f-6835-47ac-843c-335d57289cbe req-199e3452-1228-4fc7-bfed-0912922b9c48 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Neutron deleted interface 2ea934be-c527-4731-a794-d1ecd160d126; detaching it from the instance and deleting it from the info cache
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.network.neutron [req-a16b496f-6835-47ac-843c-335d57289cbe req-199e3452-1228-4fc7-bfed-0912922b9c48 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:09:15 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Took 0.50 seconds to deallocate network for instance.
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-a16b496f-6835-47ac-843c-335d57289cbe req-199e3452-1228-4fc7-bfed-0912922b9c48 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Detach interface failed, port_id=2ea934be-c527-4731-a794-d1ecd160d126, reason: Instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:09:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:15 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Deleted allocations for instance 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0
Aug 26 18:09:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-3b2ed91f-b13c-4be7-ae56-75300e2fbae8 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] Acquiring lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] Lock "3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:16 user nova-compute[73110]: DEBUG nova.compute.manager [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] No waiting events found dispatching network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:09:16 user nova-compute[73110]: WARNING nova.compute.manager [req-cbfb2030-8cc8-4d15-8c49-b46f8a9589d5 req-df3a5811-b1c8-4a63-b21a-18d1f448b8e3 service nova] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Received unexpected event network-vif-plugged-2ea934be-c527-4731-a794-d1ecd160d126 for instance with vm_state deleted and task_state None.
Aug 26 18:09:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:09:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:09:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:09:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:09:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:09:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.113880157470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 97196ae9-ebea-49a8-ab2e-2d094548922f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:09:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:09:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073354.7100468, 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:09:29 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] VM Stopped (Lifecycle Event)
Aug 26 18:09:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-834ca0fe-c704-4b58-8afb-623f1c3a3471 None None] [instance: 3d1ad6ec-e10d-4b3f-a9e2-d4ab9ffc22d0] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:09:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:09:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:09:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:09:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:00 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:10:00 user nova-compute[73110]: INFO nova.compute.claims [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Claim successful on node user
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:10:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.policy [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce8efb97268b45a1bb25476811227005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1797759abd6a48af86ab7feb4d1aed41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:10:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Creating image(s)
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "/opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "/opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "/opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.194s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.197s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk 1073741824" returned: 0 in 0.055s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:10:01 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Cannot resize image /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Ensure instance console log exists: /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Successfully created port: 955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:10:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Successfully updated port: 955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquired lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-changed-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.compute.manager [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Refreshing instance network info cache due to event network-changed-955c1904-ccf7-4151-87fb-d1ae05d45056. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] Acquiring lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Releasing lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Instance network_info: |[{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] Acquired lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Refreshing network info cache for port 955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Start _get_guest_xml network_info=[{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:10:03 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:10:03 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-787936638',display_name='tempest-VolumesSnapshotTestJSON-instance-787936638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-787936638',id=46,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh3Xhz2emqUoFcY7AWE1rHXzyeY7kS8OhjdtWXMVc7yPE0NmgoIGN/VUwcphnzEjLpQd1NuIgiS2D3RcYGLBLDR/Swq+pkv1U7eLsXZw4YgIYnLNiqRT/T7F2+coLDC3w==',key_name='tempest-keypair-365663781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-4k4gtfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=80a3ee08-e4dc-4174-a945-464b5df384ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'pci_devices' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:10:03 user nova-compute[73110]:   <uuid>80a3ee08-e4dc-4174-a945-464b5df384ee</uuid>
Aug 26 18:10:03 user nova-compute[73110]:   <name>instance-0000002e</name>
Aug 26 18:10:03 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:10:03 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:10:03 user nova-compute[73110]:   <metadata>
Aug 26 18:10:03 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:10:03 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-787936638</nova:name>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:10:03</nova:creationTime>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:10:03 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:10:03 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:owner>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:user uuid="ce8efb97268b45a1bb25476811227005">tempest-VolumesSnapshotTestJSON-872819359-project-member</nova:user>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:project uuid="1797759abd6a48af86ab7feb4d1aed41">tempest-VolumesSnapshotTestJSON-872819359</nova:project>
Aug 26 18:10:03 user nova-compute[73110]:       </nova:owner>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:10:03 user nova-compute[73110]:       <nova:ports>
Aug 26 18:10:03 user nova-compute[73110]:         <nova:port uuid="955c1904-ccf7-4151-87fb-d1ae05d45056">
Aug 26 18:10:03 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 18:10:03 user nova-compute[73110]:         </nova:port>
Aug 26 18:10:03 user nova-compute[73110]:       </nova:ports>
Aug 26 18:10:03 user nova-compute[73110]:     </nova:instance>
Aug 26 18:10:03 user nova-compute[73110]:   </metadata>
Aug 26 18:10:03 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:10:03 user nova-compute[73110]:     <system>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="serial">80a3ee08-e4dc-4174-a945-464b5df384ee</entry>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="uuid">80a3ee08-e4dc-4174-a945-464b5df384ee</entry>
Aug 26 18:10:03 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:10:03 user nova-compute[73110]:     </system>
Aug 26 18:10:03 user nova-compute[73110]:   </sysinfo>
Aug 26 18:10:03 user nova-compute[73110]:   <os>
Aug 26 18:10:03 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:10:03 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:10:03 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:10:03 user nova-compute[73110]:   </os>
Aug 26 18:10:03 user nova-compute[73110]:   <features>
Aug 26 18:10:03 user nova-compute[73110]:     <acpi/>
Aug 26 18:10:03 user nova-compute[73110]:     <apic/>
Aug 26 18:10:03 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:10:03 user nova-compute[73110]:   </features>
Aug 26 18:10:03 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:10:03 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:10:03 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:10:03 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:10:03 user nova-compute[73110]:   </clock>
Aug 26 18:10:03 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:10:03 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:10:03 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:10:03 user nova-compute[73110]:   </cpu>
Aug 26 18:10:03 user nova-compute[73110]:   <devices>
Aug 26 18:10:03 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:10:03 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:10:03 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk"/>
Aug 26 18:10:03 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:10:03 user nova-compute[73110]:     </disk>
Aug 26 18:10:03 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:10:03 user nova-compute[73110]:       <mac address="fa:16:3e:b0:6d:98"/>
Aug 26 18:10:03 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:10:03 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:10:03 user nova-compute[73110]:       <target dev="tap955c1904-cc"/>
Aug 26 18:10:03 user nova-compute[73110]:     </interface>
Aug 26 18:10:03 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:10:03 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/console.log" append="off"/>
Aug 26 18:10:03 user nova-compute[73110]:     </serial>
Aug 26 18:10:03 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:10:03 user nova-compute[73110]:     <video>
Aug 26 18:10:03 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:10:03 user nova-compute[73110]:     </video>
Aug 26 18:10:03 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:10:03 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:10:03 user nova-compute[73110]:     </rng>
Aug 26 18:10:03 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:10:03 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:10:03 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:10:03 user nova-compute[73110]:     </memballoon>
Aug 26 18:10:03 user nova-compute[73110]:   </devices>
Aug 26 18:10:03 user nova-compute[73110]: </domain>
Aug 26 18:10:03 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-787936638',display_name='tempest-VolumesSnapshotTestJSON-instance-787936638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-787936638',id=46,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh3Xhz2emqUoFcY7AWE1rHXzyeY7kS8OhjdtWXMVc7yPE0NmgoIGN/VUwcphnzEjLpQd1NuIgiS2D3RcYGLBLDR/Swq+pkv1U7eLsXZw4YgIYnLNiqRT/T7F2+coLDC3w==',key_name='tempest-keypair-365663781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-4k4gtfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=80a3ee08-e4dc-4174-a945-464b5df384ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG os_vif [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap955c1904-cc, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap955c1904-cc, col_values=(('external_ids', {'iface-id': '955c1904-ccf7-4151-87fb-d1ae05d45056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:6d:98', 'vm-uuid': '80a3ee08-e4dc-4174-a945-464b5df384ee'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:03 user nova-compute[73110]: INFO os_vif [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc')
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:10:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No VIF found with MAC fa:16:3e:b0:6d:98, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:10:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updated VIF entry in instance network info cache for port 955c1904-ccf7-4151-87fb-d1ae05d45056. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:10:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e9fce502-fe6f-4b60-8a2a-bfc4f87c264e req-a368917f-d948-45e7-a6bf-507a791b0cbb service nova] Releasing lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG nova.compute.manager [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] No waiting events found dispatching network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:05 user nova-compute[73110]: WARNING nova.compute.manager [req-aaf27b9f-f5ec-49c8-a607-eaf0c87b03cd req-918edd14-c760-4ced-96f7-98e009fcd4c4 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received unexpected event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 for instance with vm_state building and task_state spawning.
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073407.216758, 80a3ee08-e4dc-4174-a945-464b5df384ee => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] VM Resumed (Lifecycle Event)
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Instance spawned successfully.
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073407.2197194, 80a3ee08-e4dc-4174-a945-464b5df384ee => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] VM Started (Lifecycle Event)
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] No waiting events found dispatching network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:07 user nova-compute[73110]: WARNING nova.compute.manager [req-df849d40-b208-49e1-9dbe-024f662783ec req-1847601a-d0fb-4f82-8001-c1a73493394e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received unexpected event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 for instance with vm_state building and task_state spawning.
Aug 26 18:10:07 user nova-compute[73110]: INFO nova.compute.manager [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Took 6.63 seconds to build instance.
Aug 26 18:10:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-6ca0e9d7-5c1d-4a4e-8ce5-065cb64c9db2 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.728s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:13 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:10:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-changed-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Refreshing instance network info cache due to event network-changed-7775a461-4a9d-4bd0-83d8-d0e51c87a977. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:10:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] Acquiring lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:10:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] Acquired lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:10:17 user nova-compute[73110]: DEBUG nova.network.neutron [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Refreshing network info cache for port 7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:18 user nova-compute[73110]: INFO nova.compute.manager [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Terminating instance
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updated VIF entry in instance network info cache for port 7775a461-4a9d-4bd0-83d8-d0e51c87a977. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating instance_info_cache with network_info: [{"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e49f0fae-7ed6-4f36-93a4-965b00b1751f req-6b329e05-0730-4b4c-bee5-df3d96443c1b service nova] Releasing lock "refresh_cache-97196ae9-ebea-49a8-ab2e-2d094548922f" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-unplugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] No waiting events found dispatching network-vif-unplugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-2c4c8700-258b-4f37-8388-65e9f57e8617 req-97ec2b91-1d4c-453e-b3dd-d003cd67c337 service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-unplugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:10:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Instance destroyed successfully.
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.objects.instance [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid 97196ae9-ebea-49a8-ab2e-2d094548922f {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1066545695',display_name='tempest-TestVolumeBootPattern-server-1066545695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1066545695',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:08:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-g7gkhwvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:08:43Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=97196ae9-ebea-49a8-ab2e-2d094548922f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "address": "fa:16:3e:c5:08:b8", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a461-4a", "ovs_interfaceid": "7775a461-4a9d-4bd0-83d8-d0e51c87a977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_vif [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7775a461-4a, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:10:19 user nova-compute[73110]: INFO os_vif [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:b8,bridge_name='br-int',has_traffic_filtering=True,id=7775a461-4a9d-4bd0-83d8-d0e51c87a977,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a461-4a')
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:10:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37a254-ef03-4c1d-937a-71e994fe819b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[41182960-f4e1-4180-85dc-f04f89f3eca8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:10:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:10:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d2fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[349222e2-45ab-4b86-aded-53c2f5d76eba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5de83-812d-4661-8a32-2c909d9e7f0f]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[00316548-1aa3-4e11-997e-79033f4fa762]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f379435b-5a97-442a-ada6-d928e762d988]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO43560ac9-b0dfe8e79d28f541', '/dev/disk/by-id/scsi-26230646665386537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43560ac9') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5cc96-2da8-41fa-bb9c-a42049c5f3cc]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[77423b44-24fb-4f90-bff9-dfe2dd5e6700]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61f990-6819-4268-8bbd-716aa6edcd01]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]
Aug 26 18:10:19 user nova-compute[73110]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.
Aug 26 18:10:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0d130-5f55-4b92-a48a-9bc541acc5c7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (285ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:10:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Deleting instance files /opt/stack/data/nova/instances/97196ae9-ebea-49a8-ab2e-2d094548922f_del
Aug 26 18:10:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Deletion of /opt/stack/data/nova/instances/97196ae9-ebea-49a8-ab2e-2d094548922f_del complete
Aug 26 18:10:19 user nova-compute[73110]: INFO nova.compute.manager [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 18:10:19 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:10:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] Acquiring lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] No waiting events found dispatching network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:20 user nova-compute[73110]: WARNING nova.compute.manager [req-ea005298-d9bc-4f72-89c5-e44469a1844f req-1b960cea-d94e-4677-8728-feddc0b977bf service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received unexpected event network-vif-plugged-7775a461-4a9d-4bd0-83d8-d0e51c87a977 for instance with vm_state active and task_state deleting.
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-b03648ad-9118-4cf7-92fd-5249ec46b6dc req-9bfabd1e-0e7b-4234-9a9b-1e56c5095f1e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Received event network-vif-deleted-7775a461-4a9d-4bd0-83d8-d0e51c87a977 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:21 user nova-compute[73110]: INFO nova.compute.manager [req-b03648ad-9118-4cf7-92fd-5249ec46b6dc req-9bfabd1e-0e7b-4234-9a9b-1e56c5095f1e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Neutron deleted interface 7775a461-4a9d-4bd0-83d8-d0e51c87a977; detaching it from the instance and deleting it from the info cache
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-b03648ad-9118-4cf7-92fd-5249ec46b6dc req-9bfabd1e-0e7b-4234-9a9b-1e56c5095f1e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:21 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Took 1.61 seconds to deallocate network for instance.
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-b03648ad-9118-4cf7-92fd-5249ec46b6dc req-9bfabd1e-0e7b-4234-9a9b-1e56c5095f1e service nova] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Detach interface failed, port_id=7775a461-4a9d-4bd0-83d8-d0e51c87a977, reason: Instance 97196ae9-ebea-49a8-ab2e-2d094548922f could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:10:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:10:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.19793701171875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 97196ae9-ebea-49a8-ab2e-2d094548922f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 80a3ee08-e4dc-4174-a945-464b5df384ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:10:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:21 user nova-compute[73110]: INFO nova.compute.manager [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 18:10:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:22 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:10:22 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:10:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:22 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance 97196ae9-ebea-49a8-ab2e-2d094548922f
Aug 26 18:10:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82b05b7c-dbe0-49c0-816e-e83abe12c715 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "97196ae9-ebea-49a8-ab2e-2d094548922f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.969s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing instance network info cache due to event network-changed-419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] Acquiring lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] Acquired lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Refreshing network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:10:28 user nova-compute[73110]: INFO nova.compute.manager [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Terminating instance
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-unplugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] No waiting events found dispatching network-vif-unplugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.compute.manager [req-e490cda4-6729-4ba5-8e09-f19e7b89ed56 req-69aaef97-67c1-483d-9982-dd9103355b63 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-unplugged-419ace13-8fdb-4f3e-a89b-689457696e88 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updated VIF entry in instance network info cache for port 419ace13-8fdb-4f3e-a89b-689457696e88. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [{"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c1261427-4089-4d3e-af6c-771bd37dadb9 req-d4343f6d-e106-4a1a-858d-34afa1e4df1a service nova] Releasing lock "refresh_cache-1d17f7fc-88c5-4270-9249-52dbe3d9354a" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:10:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Instance destroyed successfully.
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lazy-loading 'resources' on Instance uuid 1d17f7fc-88c5-4270-9249-52dbe3d9354a {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-717098164',display_name='tempest-TestStampPattern-server-717098164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-717098164',id=41,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP70T+51T+dmTV6XejRmfm/6ijhW8RLOwayETvlSp1Q2vQd4hJD9QZ8P+JI7NVSyVuym/m9/1Gye5oSSofiXcE661oFlmlQbkXaBnBNF74N+JM5lPVyD9iyGmaZ8pzibg==',key_name='tempest-TestStampPattern-381173867',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='205df4d98cf24ae48843664efb353420',ramdisk_id='',reservation_id='r-asl1is5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-277351961',owner_user_name='tempest-TestStampPattern-277351961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:06:09Z,user_data=None,user_id='62e166fb79ac46669ca6580d0bb1b6eb',uuid=1d17f7fc-88c5-4270-9249-52dbe3d9354a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converting VIF {"id": "419ace13-8fdb-4f3e-a89b-689457696e88", "address": "fa:16:3e:11:9a:f6", "network": {"id": "66dde9a7-a9c0-452d-b0d3-738cf7f516b0", "bridge": "br-int", "label": "tempest-TestStampPattern-152294081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "205df4d98cf24ae48843664efb353420", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419ace13-8f", "ovs_interfaceid": "419ace13-8fdb-4f3e-a89b-689457696e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG os_vif [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419ace13-8f, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:10:28 user nova-compute[73110]: INFO os_vif [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=419ace13-8fdb-4f3e-a89b-689457696e88,network=Network(66dde9a7-a9c0-452d-b0d3-738cf7f516b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419ace13-8f')
Aug 26 18:10:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Deleting instance files /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a_del
Aug 26 18:10:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Deletion of /opt/stack/data/nova/instances/1d17f7fc-88c5-4270-9249-52dbe3d9354a_del complete
Aug 26 18:10:29 user nova-compute[73110]: INFO nova.compute.manager [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 18:10:29 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:10:29 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Took 0.63 seconds to deallocate network for instance.
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-dfe7170a-366f-46be-b60a-e84ba4d6a5d5 req-1fae6b0d-20fe-41d0-b7f2-3aea48de5ed4 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-deleted-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:10:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:29 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Deleted allocations for instance 1d17f7fc-88c5-4270-9249-52dbe3d9354a
Aug 26 18:10:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cef53a43-9b47-4929-ab18-e15e337233e3 tempest-TestStampPattern-277351961 tempest-TestStampPattern-277351961-project-member] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.963s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] Acquiring lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] Lock "1d17f7fc-88c5-4270-9249-52dbe3d9354a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] No waiting events found dispatching network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:10:30 user nova-compute[73110]: WARNING nova.compute.manager [req-f18cb8c1-5028-4f86-8ce8-518e5d5ec3df req-cea24505-0b42-4ab5-b3f8-31c9343b1fa2 service nova] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Received unexpected event network-vif-plugged-419ace13-8fdb-4f3e-a89b-689457696e88 for instance with vm_state deleted and task_state None.
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:10:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:34 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073419.1359532, 97196ae9-ebea-49a8-ab2e-2d094548922f => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:10:34 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] VM Stopped (Lifecycle Event)
Aug 26 18:10:34 user nova-compute[73110]: DEBUG nova.compute.manager [None req-79ee97e6-6dc0-4caf-939f-b27480d715d4 None None] [instance: 97196ae9-ebea-49a8-ab2e-2d094548922f] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:10:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073428.8861182, 1d17f7fc-88c5-4270-9249-52dbe3d9354a => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:10:43 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] VM Stopped (Lifecycle Event)
Aug 26 18:10:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-3eb90866-d499-4665-9564-7edbb0850493 None None] [instance: 1d17f7fc-88c5-4270-9249-52dbe3d9354a] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:10:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:10:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:11:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:11:10 user nova-compute[73110]: INFO nova.compute.claims [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Claim successful on node user
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:11:10 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:11:10 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:11:11 user nova-compute[73110]: INFO nova.virt.block_device [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Booting with volume ba48cdfb-a8b5-4603-b77e-36e1a07e2347 at /dev/vda
Aug 26 18:11:11 user nova-compute[73110]: DEBUG nova.policy [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.utils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[320122fa-cfae-4cde-9afa-39307969842f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fc674-4145-4f7e-87b0-a64ac03cef6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[671465c6-5ff9-411f-8bc2-1405272ccfd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df293ed-8495-4ca6-bfba-44f05d6e8b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:11:11 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:11:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053c6c2-617f-41e8-b5cc-a0aec2a9c024]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG os_brick.utils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating existing volume attachment record: 78e6c70d-aa0d-4e3c-a59a-5bcb6713a690 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:11:11 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Successfully created port: f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Successfully updated port: f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing instance network info cache due to event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:12 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG nova.network.neutron [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Instance network_info: |[{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updated VIF entry in instance network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3bffb7c7-a926-40a9-8dc8-fe418980b907 req-889ee260-d447-437d-b8dd-c91dfd093f19 service nova] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:11:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:11:15 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:15 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:11:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:11:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Creating image(s)
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Ensure instance console log exists: /opt/stack/data/nova/instances/b64db151-bb30-44d4-b9c9-51e88b0ecbe5/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Start _get_guest_xml network_info=[{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '78e6c70d-aa0d-4e3c-a59a-5bcb6713a690', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b64db151-bb30-44d4-b9c9-51e88b0ecbe5', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba48cdfb-a8b5-4603-b77e-36e1a07e2347', 'serial': 'ba48cdfb-a8b5-4603-b77e-36e1a07e2347'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:11:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:22 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:11:22 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:11:22 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:11:22 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de695cd-7455-4132-8197-a8f56314f79f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:11:22 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414c82b-b927-4005-b471-1d751b4a3af7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347] added
Aug 26 18:11:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d35fc6e-7055-408f-8072-69ee6ae78b8c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2b5f2d-ec03-4c0e-87e8-8d8313f68328]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RESmxeas {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RESmxeas" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[95693885-33fa-4e83-b5ca-fb0a99ec19a9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RESmxeas'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[49881682-6ed7-49af-b046-d3012e1edafe]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ed931-4007-41e6-873b-1018f61b5bed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:11:22 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:11:22 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:11:22 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:11:22 user nova-compute[73110]: 
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7db61-a443-4818-bcba-936cb3949974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]
Aug 26 18:11:22 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.
Aug 26 18:11:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c241f-2fa3-4e87-b64d-76996a4d19e1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c2bfc-3942-4e43-90dd-61d6dc6aac1e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:11:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:11:22 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5597d2-4b7a-4ed8-b3f4-60e83ad48a4c]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:22 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:23 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:23 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.187061309814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 80a3ee08-e4dc-4174-a945-464b5df384ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26230646665386537', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230646665386537', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1001648231',display_name='tempest-TestVolumeBootPattern-server-1001648231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1001648231',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-bxlqejtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:11:11Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=b64db151-bb30-44d4-b9c9-51e88b0ecbe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid b64db151-bb30-44d4-b9c9-51e88b0ecbe5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:11:23 user nova-compute[73110]:   <uuid>b64db151-bb30-44d4-b9c9-51e88b0ecbe5</uuid>
Aug 26 18:11:23 user nova-compute[73110]:   <name>instance-0000002f</name>
Aug 26 18:11:23 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:11:23 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:11:23 user nova-compute[73110]:   <metadata>
Aug 26 18:11:23 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:11:23 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:11:23 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-server-1001648231</nova:name>
Aug 26 18:11:23 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:11:22</nova:creationTime>
Aug 26 18:11:23 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:11:23 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:11:23 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:11:23 user nova-compute[73110]:       <nova:owner>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 18:11:23 user nova-compute[73110]:       </nova:owner>
Aug 26 18:11:23 user nova-compute[73110]:       <nova:ports>
Aug 26 18:11:23 user nova-compute[73110]:         <nova:port uuid="f3295ca9-aa32-4a06-953c-4ef7145a2427">
Aug 26 18:11:23 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 18:11:23 user nova-compute[73110]:         </nova:port>
Aug 26 18:11:23 user nova-compute[73110]:       </nova:ports>
Aug 26 18:11:23 user nova-compute[73110]:     </nova:instance>
Aug 26 18:11:23 user nova-compute[73110]:   </metadata>
Aug 26 18:11:23 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:11:23 user nova-compute[73110]:     <system>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="serial">b64db151-bb30-44d4-b9c9-51e88b0ecbe5</entry>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="uuid">b64db151-bb30-44d4-b9c9-51e88b0ecbe5</entry>
Aug 26 18:11:23 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:11:23 user nova-compute[73110]:     </system>
Aug 26 18:11:23 user nova-compute[73110]:   </sysinfo>
Aug 26 18:11:23 user nova-compute[73110]:   <os>
Aug 26 18:11:23 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:11:23 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:11:23 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:11:23 user nova-compute[73110]:   </os>
Aug 26 18:11:23 user nova-compute[73110]:   <features>
Aug 26 18:11:23 user nova-compute[73110]:     <acpi/>
Aug 26 18:11:23 user nova-compute[73110]:     <apic/>
Aug 26 18:11:23 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:11:23 user nova-compute[73110]:   </features>
Aug 26 18:11:23 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:11:23 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:11:23 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:11:23 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:11:23 user nova-compute[73110]:   </clock>
Aug 26 18:11:23 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:11:23 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:11:23 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:11:23 user nova-compute[73110]:   </cpu>
Aug 26 18:11:23 user nova-compute[73110]:   <devices>
Aug 26 18:11:23 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:11:23 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:11:23 user nova-compute[73110]:       <source dev="/dev/sdb"/>
Aug 26 18:11:23 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:11:23 user nova-compute[73110]:       <serial>ba48cdfb-a8b5-4603-b77e-36e1a07e2347</serial>
Aug 26 18:11:23 user nova-compute[73110]:     </disk>
Aug 26 18:11:23 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:11:23 user nova-compute[73110]:       <mac address="fa:16:3e:fd:44:96"/>
Aug 26 18:11:23 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:11:23 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:11:23 user nova-compute[73110]:       <target dev="tapf3295ca9-aa"/>
Aug 26 18:11:23 user nova-compute[73110]:     </interface>
Aug 26 18:11:23 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:11:23 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/b64db151-bb30-44d4-b9c9-51e88b0ecbe5/console.log" append="off"/>
Aug 26 18:11:23 user nova-compute[73110]:     </serial>
Aug 26 18:11:23 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:11:23 user nova-compute[73110]:     <video>
Aug 26 18:11:23 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:11:23 user nova-compute[73110]:     </video>
Aug 26 18:11:23 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:11:23 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:11:23 user nova-compute[73110]:     </rng>
Aug 26 18:11:23 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:11:23 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:11:23 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:11:23 user nova-compute[73110]:     </memballoon>
Aug 26 18:11:23 user nova-compute[73110]:   </devices>
Aug 26 18:11:23 user nova-compute[73110]: </domain>
Aug 26 18:11:23 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1001648231',display_name='tempest-TestVolumeBootPattern-server-1001648231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1001648231',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-bxlqejtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:11:11Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=b64db151-bb30-44d4-b9c9-51e88b0ecbe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG os_vif [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3295ca9-aa, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3295ca9-aa, col_values=(('external_ids', {'iface-id': 'f3295ca9-aa32-4a06-953c-4ef7145a2427', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:44:96', 'vm-uuid': 'b64db151-bb30-44d4-b9c9-51e88b0ecbe5'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:23 user nova-compute[73110]: INFO os_vif [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa')
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:11:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:fd:44:96, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:11:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] No waiting events found dispatching network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:11:25 user nova-compute[73110]: WARNING nova.compute.manager [req-9ed2ba67-2fb8-475c-ade1-2f7b29de670b req-75e6307e-eed6-436d-a821-fc0b88fbd665 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received unexpected event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 for instance with vm_state building and task_state spawning.
Aug 26 18:11:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] No waiting events found dispatching network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:11:27 user nova-compute[73110]: WARNING nova.compute.manager [req-45bcb593-fd6e-4be5-b3bf-12d48114ee58 req-2bc2c9ed-0d73-4462-aa44-df64ed615929 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received unexpected event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 for instance with vm_state building and task_state spawning.
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073487.1798067, b64db151-bb30-44d4-b9c9-51e88b0ecbe5 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] VM Resumed (Lifecycle Event)
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Instance spawned successfully.
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073487.1811123, b64db151-bb30-44d4-b9c9-51e88b0ecbe5 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] VM Started (Lifecycle Event)
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 26 18:11:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:11:27 user nova-compute[73110]: INFO nova.compute.manager [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Took 16.91 seconds to build instance.
Aug 26 18:11:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-7075b2ac-26d7-4f40-a256-ada6f345b070 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.015s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:11:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:11:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:11:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-changed-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG nova.compute.manager [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Refreshing instance network info cache due to event network-changed-955c1904-ccf7-4151-87fb-d1ae05d45056. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] Acquiring lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] Acquired lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG nova.network.neutron [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Refreshing network info cache for port 955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG nova.objects.instance [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:11:52 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Ignoring supplied device name: /dev/vdb
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:52 user nova-compute[73110]: INFO nova.compute.manager [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Attaching volume 7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb to /dev/vdb
Aug 26 18:11:52 user nova-compute[73110]: DEBUG os_brick.utils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8050c6a0-aa87-4c1c-9f27-ab55280685a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a7eed-3158-436b-bdb8-a82f770af33e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updated VIF entry in instance network info cache for port 955c1904-ccf7-4151-87fb-d1ae05d45056. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cc00d6-9d74-4d9f-a958-c9ab6a2874dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c975d6-96fc-4c12-986d-74160ad1a079]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-596f02dc-fd3b-45bc-9cc5-7be5a1f5c735 req-53a5b7b5-894b-479d-92dc-d9c7fcf74480 service nova] Releasing lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:11:53 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:11:53 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799ac6e-e33e-49d0-8792-e43ddb7b02b3]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG os_brick.utils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating existing volume attachment record: 9542d319-9dfa-4bbd-af01-9d74cbb005a9 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:11:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:55 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:11:56 user nova-compute[73110]: INFO nova.compute.claims [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Claim successful on node user
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:11:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.policy [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2359790ef72c447681b40e1548d1d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9330d1982ea343b691f895aeddde36db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:11:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Creating image(s)
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "9f4ea44252143a054e4519d7623e726c5620a2f0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "9f4ea44252143a054e4519d7623e726c5620a2f0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.part --force-share --output=json" returned: 0 in 0.196s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG nova.virt.images [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] 842052f8-a7ab-4aba-a695-ee23d2043c41 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.part /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.part /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.converted" returned: 0 in 0.319s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Successfully created port: 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "9f4ea44252143a054e4519d7623e726c5620a2f0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.514s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json" returned: 0 in 0.228s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "9f4ea44252143a054e4519d7623e726c5620a2f0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "9f4ea44252143a054e4519d7623e726c5620a2f0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0,backing_fmt=raw /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0,backing_fmt=raw /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk 1073741824" returned: 0 in 0.058s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "9f4ea44252143a054e4519d7623e726c5620a2f0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Successfully updated port: 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json" returned: 0 in 0.215s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing instance network info cache due to event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Cannot resize image /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Ensure instance console log exists: /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:11:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.neutron [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance network_info: |[{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start _get_guest_xml network_info=[{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T18:11:53Z,direct_url=<?>,disk_format='qcow2',id=842052f8-a7ab-4aba-a695-ee23d2043c41,min_disk=0,min_ram=0,name='tempest-scenario-img--947997985',owner='9330d1982ea343b691f895aeddde36db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T18:11:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '842052f8-a7ab-4aba-a695-ee23d2043c41'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:11:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:59 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T18:11:53Z,direct_url=<?>,disk_format='qcow2',id=842052f8-a7ab-4aba-a695-ee23d2043c41,min_disk=0,min_ram=0,name='tempest-scenario-img--947997985',owner='9330d1982ea343b691f895aeddde36db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T18:11:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:11:56Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'pci_devices' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:11:59 user nova-compute[73110]:   <uuid>63e267f9-e38d-4b07-b076-b4e76ccc5aff</uuid>
Aug 26 18:11:59 user nova-compute[73110]:   <name>instance-00000030</name>
Aug 26 18:11:59 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:11:59 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:11:59 user nova-compute[73110]:   <metadata>
Aug 26 18:11:59 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:11:59 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:name>tempest-TestMinimumBasicScenario-server-1669295859</nova:name>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:11:59</nova:creationTime>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:11:59 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:11:59 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:owner>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:user uuid="2359790ef72c447681b40e1548d1d2f2">tempest-TestMinimumBasicScenario-51070138-project-member</nova:user>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:project uuid="9330d1982ea343b691f895aeddde36db">tempest-TestMinimumBasicScenario-51070138</nova:project>
Aug 26 18:11:59 user nova-compute[73110]:       </nova:owner>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:root type="image" uuid="842052f8-a7ab-4aba-a695-ee23d2043c41"/>
Aug 26 18:11:59 user nova-compute[73110]:       <nova:ports>
Aug 26 18:11:59 user nova-compute[73110]:         <nova:port uuid="033c43b5-ad80-45a8-a57a-e5bd6cf76b92">
Aug 26 18:11:59 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 18:11:59 user nova-compute[73110]:         </nova:port>
Aug 26 18:11:59 user nova-compute[73110]:       </nova:ports>
Aug 26 18:11:59 user nova-compute[73110]:     </nova:instance>
Aug 26 18:11:59 user nova-compute[73110]:   </metadata>
Aug 26 18:11:59 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:11:59 user nova-compute[73110]:     <system>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="serial">63e267f9-e38d-4b07-b076-b4e76ccc5aff</entry>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="uuid">63e267f9-e38d-4b07-b076-b4e76ccc5aff</entry>
Aug 26 18:11:59 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:11:59 user nova-compute[73110]:     </system>
Aug 26 18:11:59 user nova-compute[73110]:   </sysinfo>
Aug 26 18:11:59 user nova-compute[73110]:   <os>
Aug 26 18:11:59 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:11:59 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:11:59 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:11:59 user nova-compute[73110]:   </os>
Aug 26 18:11:59 user nova-compute[73110]:   <features>
Aug 26 18:11:59 user nova-compute[73110]:     <acpi/>
Aug 26 18:11:59 user nova-compute[73110]:     <apic/>
Aug 26 18:11:59 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:11:59 user nova-compute[73110]:   </features>
Aug 26 18:11:59 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:11:59 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:11:59 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:11:59 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:11:59 user nova-compute[73110]:   </clock>
Aug 26 18:11:59 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:11:59 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:11:59 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:11:59 user nova-compute[73110]:   </cpu>
Aug 26 18:11:59 user nova-compute[73110]:   <devices>
Aug 26 18:11:59 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:11:59 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:11:59 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk"/>
Aug 26 18:11:59 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:11:59 user nova-compute[73110]:     </disk>
Aug 26 18:11:59 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:11:59 user nova-compute[73110]:       <mac address="fa:16:3e:12:f8:94"/>
Aug 26 18:11:59 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:11:59 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:11:59 user nova-compute[73110]:       <target dev="tap033c43b5-ad"/>
Aug 26 18:11:59 user nova-compute[73110]:     </interface>
Aug 26 18:11:59 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:11:59 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/console.log" append="off"/>
Aug 26 18:11:59 user nova-compute[73110]:     </serial>
Aug 26 18:11:59 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:11:59 user nova-compute[73110]:     <video>
Aug 26 18:11:59 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:11:59 user nova-compute[73110]:     </video>
Aug 26 18:11:59 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:11:59 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:11:59 user nova-compute[73110]:     </rng>
Aug 26 18:11:59 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:11:59 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:11:59 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:11:59 user nova-compute[73110]:     </memballoon>
Aug 26 18:11:59 user nova-compute[73110]:   </devices>
Aug 26 18:11:59 user nova-compute[73110]: </domain>
Aug 26 18:11:59 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:11:56Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG os_vif [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap033c43b5-ad, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap033c43b5-ad, col_values=(('external_ids', {'iface-id': '033c43b5-ad80-45a8-a57a-e5bd6cf76b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:f8:94', 'vm-uuid': '63e267f9-e38d-4b07-b076-b4e76ccc5aff'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:11:59 user nova-compute[73110]: INFO os_vif [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad')
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No VIF found with MAC fa:16:3e:12:f8:94, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated VIF entry in instance network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG nova.network.neutron [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:11:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a39cf26-2143-4512-b597-01abeb513771 req-a61a248b-89dd-4170-8e43-e1de99b4eee0 service nova] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:12:00 user nova-compute[73110]: WARNING nova.compute.manager [req-704d4366-72a6-47f8-a855-1654c41da8d3 req-ae0087a6-53f8-4ea5-91ca-287b9125aea4 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state building and task_state spawning.
Aug 26 18:12:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073522.866314, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:12:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] VM Resumed (Lifecycle Event)
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:12:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance spawned successfully.
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073522.8684225, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:12:02 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] VM Started (Lifecycle Event)
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:12:02 user nova-compute[73110]: WARNING nova.compute.manager [req-c47654b0-4d3a-47fe-b83e-40c43e87319f req-4f303caf-86c1-4be5-be10-ab0af414207b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state building and task_state spawning.
Aug 26 18:12:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:12:03 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:12:03 user nova-compute[73110]: INFO nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 26 18:12:03 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:03 user nova-compute[73110]: INFO nova.compute.manager [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Took 7.21 seconds to build instance.
Aug 26 18:12:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ce689746-bd51-43b4-a41b-95a2acfe72b5 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.314s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCWVOyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:12:04 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:04 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:04 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1817ea39-f93a-4af6-8e2f-a20db5ea9304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:12:04 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9509fdf5-816e-43f2-9be7-e75031745961]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb] added
Aug 26 18:12:04 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a0738-9a8d-44e1-b6a6-016f08ebf014]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[734add76-e628-4dc4-a1cc-824629856248]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCWVOyTX {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCWVOyTX" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b94bd-3cd1-4810-b135-b13533af16ce]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCWVOyTX'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd4ab1-b9af-464b-a452-d43f74efbca6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d54a2-ed58-4674-af8f-ca7a25dde4b0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:04 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:04 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91addff-8dee-45e4-a77f-b8513bb6b1ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260]
Aug 26 18:12:04 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:12:04 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.157s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:04 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e01b27-028b-49f4-a538-c62ef829c65f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340ead7-8d94-440c-a03f-6f31c4ceccd8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:05 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:05 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0cf98d-82bd-4f84-980d-3c21043a9ab7]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCWVOyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:12:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '26237366565383365', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237366565383365', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.objects.instance [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:12:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:12:06 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:12:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:12:06 user nova-compute[73110]:   <serial>7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb</serial>
Aug 26 18:12:06 user nova-compute[73110]: </disk>
Aug 26 18:12:06 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No VIF found with MAC fa:16:3e:b0:6d:98, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-dd8f379b-4288-4f42-bc91-9009fcae1a85 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.809s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:12:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [{"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-80a3ee08-e4dc-4174-a945-464b5df384ee" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:12:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:12:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:12:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=25.08533477783203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 80a3ee08-e4dc-4174-a945-464b5df384ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:12:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:12:27 user nova-compute[73110]: INFO nova.compute.claims [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Claim successful on node user
Aug 26 18:12:27 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:12:28 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.policy [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c70b048fb80b4bbe9d4e7cd5c0c58b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b02e837cbe0450aadbbc4e1e2edd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:12:28 user nova-compute[73110]: INFO nova.virt.block_device [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Booting with volume 8fb12861-de40-4303-9671-6e1daa8d11eb at /dev/vda
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.utils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd24f5-0a5e-4b51-b1bb-05ed69a313c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64d5a3-730d-4e7a-be4f-6b45f3d38853]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c6d77-9b13-4bd6-818a-a445a976608c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e2bf5-85cb-4790-a6d3-7cf95bd74039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:12:28 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:12:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3984a-885f-4d15-9a28-9370173d5984]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG os_brick.utils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating existing volume attachment record: 2fd34495-b056-4ec9-ae5b-5649bb3dd164 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:12:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Successfully created port: db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:12:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Successfully updated port: db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing instance network info cache due to event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance network_info: |[{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:12:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updated VIF entry in instance network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:12:31 user nova-compute[73110]: DEBUG nova.network.neutron [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:12:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-9f8b6d0f-534d-472b-808f-e60b07fe385d req-282cdd21-1291-42ea-9f6f-7577ebac02de service nova] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:12:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:12:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:12:39 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Creating image(s)
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Ensure instance console log exists: /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start _get_guest_xml network_info=[{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2fd34495-b056-4ec9-ae5b-5649bb3dd164', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b174a3-711e-4f66-a2ea-4d3d5a8c54d5', 'attached_at': '', 'detached_at': '', 'volume_id': '8fb12861-de40-4303-9671-6e1daa8d11eb', 'serial': '8fb12861-de40-4303-9671-6e1daa8d11eb'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:12:39 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:12:39 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:12:39 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:39 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:39 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c017498e-a513-4581-a9ae-547bece0482c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:12:39 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f0638e-5cba-4845-9ef1-fb45ac8ff514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb] added
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba29f7e-2452-49c4-86b3-2e252622870c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e01163-f8d1-4686-8f75-ba2c77b2d79a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMuavVHA {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMuavVHA" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db730f-70ee-4bfd-8195-3e8d8a52c826]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMuavVHA'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[519aef37-2afd-4e46-b5fc-87131ba36fa1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9237742-d88c-4ba5-b6ae-76603ec82185]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e9a60-96b2-4209-98f2-6afa923413c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]
Aug 26 18:12:39 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[37854c5a-0023-4094-97b9-ed0e0c9e3c58]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c005b33-7e32-42bd-a51d-81794b08303c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:39 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0121e9e-f675-4c67-b02a-f2996cafcca5]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:12:39 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23538626661363239', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538626661363239', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX1mVxuUTl23T8T0z27JxGhgKJiOnXE7xOwWSl5Tj6mr6fOnAZ+PVa05xUNPRuzC98FCxY4GKuQR4UDvLDNhzjBcAWWDIZthsP50nVaGl8LjPulWv/AClLmYE223GTOiA==',key_name='tempest-TestShelveInstance-235173116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:12:28Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.objects.instance [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:12:40 user nova-compute[73110]:   <uuid>85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</uuid>
Aug 26 18:12:40 user nova-compute[73110]:   <name>instance-00000031</name>
Aug 26 18:12:40 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:12:40 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:12:40 user nova-compute[73110]:   <metadata>
Aug 26 18:12:40 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:12:40 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:12:40 user nova-compute[73110]:       <nova:name>tempest-TestShelveInstance-server-889878797</nova:name>
Aug 26 18:12:40 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:12:39</nova:creationTime>
Aug 26 18:12:40 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:12:40 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:12:40 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:12:40 user nova-compute[73110]:       <nova:owner>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:user uuid="c70b048fb80b4bbe9d4e7cd5c0c58b46">tempest-TestShelveInstance-1970110709-project-member</nova:user>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:project uuid="9b02e837cbe0450aadbbc4e1e2edd2e8">tempest-TestShelveInstance-1970110709</nova:project>
Aug 26 18:12:40 user nova-compute[73110]:       </nova:owner>
Aug 26 18:12:40 user nova-compute[73110]:       <nova:ports>
Aug 26 18:12:40 user nova-compute[73110]:         <nova:port uuid="db7b3a2a-e250-4dd9-a150-6884a7790104">
Aug 26 18:12:40 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 18:12:40 user nova-compute[73110]:         </nova:port>
Aug 26 18:12:40 user nova-compute[73110]:       </nova:ports>
Aug 26 18:12:40 user nova-compute[73110]:     </nova:instance>
Aug 26 18:12:40 user nova-compute[73110]:   </metadata>
Aug 26 18:12:40 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:12:40 user nova-compute[73110]:     <system>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="serial">85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</entry>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="uuid">85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</entry>
Aug 26 18:12:40 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:12:40 user nova-compute[73110]:     </system>
Aug 26 18:12:40 user nova-compute[73110]:   </sysinfo>
Aug 26 18:12:40 user nova-compute[73110]:   <os>
Aug 26 18:12:40 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:12:40 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:12:40 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:12:40 user nova-compute[73110]:   </os>
Aug 26 18:12:40 user nova-compute[73110]:   <features>
Aug 26 18:12:40 user nova-compute[73110]:     <acpi/>
Aug 26 18:12:40 user nova-compute[73110]:     <apic/>
Aug 26 18:12:40 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:12:40 user nova-compute[73110]:   </features>
Aug 26 18:12:40 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:12:40 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:12:40 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:12:40 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:12:40 user nova-compute[73110]:   </clock>
Aug 26 18:12:40 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:12:40 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:12:40 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:12:40 user nova-compute[73110]:   </cpu>
Aug 26 18:12:40 user nova-compute[73110]:   <devices>
Aug 26 18:12:40 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:12:40 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:12:40 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 18:12:40 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:12:40 user nova-compute[73110]:       <serial>8fb12861-de40-4303-9671-6e1daa8d11eb</serial>
Aug 26 18:12:40 user nova-compute[73110]:     </disk>
Aug 26 18:12:40 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:12:40 user nova-compute[73110]:       <mac address="fa:16:3e:48:1d:c6"/>
Aug 26 18:12:40 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:12:40 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:12:40 user nova-compute[73110]:       <target dev="tapdb7b3a2a-e2"/>
Aug 26 18:12:40 user nova-compute[73110]:     </interface>
Aug 26 18:12:40 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:12:40 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5/console.log" append="off"/>
Aug 26 18:12:40 user nova-compute[73110]:     </serial>
Aug 26 18:12:40 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:12:40 user nova-compute[73110]:     <video>
Aug 26 18:12:40 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:12:40 user nova-compute[73110]:     </video>
Aug 26 18:12:40 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:12:40 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:12:40 user nova-compute[73110]:     </rng>
Aug 26 18:12:40 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:12:40 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:12:40 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:12:40 user nova-compute[73110]:     </memballoon>
Aug 26 18:12:40 user nova-compute[73110]:   </devices>
Aug 26 18:12:40 user nova-compute[73110]: </domain>
Aug 26 18:12:40 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX1mVxuUTl23T8T0z27JxGhgKJiOnXE7xOwWSl5Tj6mr6fOnAZ+PVa05xUNPRuzC98FCxY4GKuQR4UDvLDNhzjBcAWWDIZthsP50nVaGl8LjPulWv/AClLmYE223GTOiA==',key_name='tempest-TestShelveInstance-235173116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:12:28Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG os_vif [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb7b3a2a-e2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb7b3a2a-e2, col_values=(('external_ids', {'iface-id': 'db7b3a2a-e250-4dd9-a150-6884a7790104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:1d:c6', 'vm-uuid': '85b174a3-711e-4f66-a2ea-4d3d5a8c54d5'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:40 user nova-compute[73110]: INFO os_vif [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2')
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:12:40 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] No VIF found with MAC fa:16:3e:48:1d:c6, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG nova.compute.manager [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:12:42 user nova-compute[73110]: WARNING nova.compute.manager [req-b0c0797b-624a-426d-9f86-4af31c8a8f7d req-e6216627-40a7-4ffa-b3dd-5614e881b242 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state building and task_state spawning.
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073564.2705708, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Resumed (Lifecycle Event)
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance spawned successfully.
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073564.2719054, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Started (Lifecycle Event)
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:44 user nova-compute[73110]: DEBUG nova.compute.manager [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:12:44 user nova-compute[73110]: WARNING nova.compute.manager [req-ba626717-7cc7-41a2-aa40-75c7f2ce4e39 req-aa0f83c1-1a4a-4fb6-b1a1-2480d6e100cb service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state building and task_state spawning.
Aug 26 18:12:44 user nova-compute[73110]: INFO nova.compute.manager [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Took 16.93 seconds to build instance.
Aug 26 18:12:44 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-563384f0-3529-4b23-a67a-fe5615540a0e tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.025s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:56 user nova-compute[73110]: INFO nova.compute.manager [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Detaching volume 7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb
Aug 26 18:12:56 user nova-compute[73110]: INFO nova.virt.block_device [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Attempting to driver detach volume 7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb from mountpoint /dev/vdb
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Attempting to detach device vdb from instance 80a3ee08-e4dc-4174-a945-464b5df384ee from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:12:56 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:12:56 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:12:56 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:12:56 user nova-compute[73110]:   <serial>7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb</serial>
Aug 26 18:12:56 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:12:56 user nova-compute[73110]: </disk>
Aug 26 18:12:56 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:12:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully detached device vdb from instance 80a3ee08-e4dc-4174-a945-464b5df384ee from the persistent domain config.
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80a3ee08-e4dc-4174-a945-464b5df384ee from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:12:56 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:12:56 user nova-compute[73110]:   <source dev="/dev/sdc"/>
Aug 26 18:12:56 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:12:56 user nova-compute[73110]:   <serial>7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb</serial>
Aug 26 18:12:56 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:12:56 user nova-compute[73110]: </disk>
Aug 26 18:12:56 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073576.7070231, 80a3ee08-e4dc-4174-a945-464b5df384ee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:12:56 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully detached device vdb from instance 80a3ee08-e4dc-4174-a945-464b5df384ee from the live domain config.
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCWVOyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:12:56 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a55ec-284d-4b9f-9a41-06cb42aa685c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95ec7b3-6118-4fd6-a442-f48371c9e820]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:56 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:56 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:56 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:56 user nova-compute[73110]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb (non-flash)
Aug 26 18:12:56 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:56 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5447048b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92066c1-319b-402c-a2d7-baa6b182c7d2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc526884-2abe-46ed-bcfb-4cd32975a3f7]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[65644625-8c64-48f6-9bb5-3c50e1205921]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[debac41c-5738-4868-8171-998c2f4340c0]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6026f-3a2b-4b78-bc21-be4f96dcc12c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24eea0c-8343-4b29-8e6d-948fce176332]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260]
Aug 26 18:12:56 user nova-compute[73110]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:12:56 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3573af47-74b1-42b2-ba87-b776e7ace57b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== disconnect_volume: return (271ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:12:56 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG nova.objects.instance [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-fcbc51d3-ebdc-4291-adf5-94fbe1b95c42 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.227s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.118s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:58 user nova-compute[73110]: INFO nova.compute.manager [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Terminating instance
Aug 26 18:12:58 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-unplugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] No waiting events found dispatching network-vif-unplugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:12:58 user nova-compute[73110]: DEBUG nova.compute.manager [req-e134127b-6801-44c3-846b-1960b4a20231 req-9d0c120b-7214-48a6-bda2-9dc35e56945d service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-unplugged-955c1904-ccf7-4151-87fb-d1ae05d45056 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:12:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Instance destroyed successfully.
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'resources' on Instance uuid 80a3ee08-e4dc-4174-a945-464b5df384ee {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-787936638',display_name='tempest-VolumesSnapshotTestJSON-instance-787936638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-787936638',id=46,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh3Xhz2emqUoFcY7AWE1rHXzyeY7kS8OhjdtWXMVc7yPE0NmgoIGN/VUwcphnzEjLpQd1NuIgiS2D3RcYGLBLDR/Swq+pkv1U7eLsXZw4YgIYnLNiqRT/T7F2+coLDC3w==',key_name='tempest-keypair-365663781',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-4k4gtfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=80a3ee08-e4dc-4174-a945-464b5df384ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "955c1904-ccf7-4151-87fb-d1ae05d45056", "address": "fa:16:3e:b0:6d:98", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955c1904-cc", "ovs_interfaceid": "955c1904-ccf7-4151-87fb-d1ae05d45056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_vif [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap955c1904-cc, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:12:59 user nova-compute[73110]: INFO os_vif [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6d:98,bridge_name='br-int',has_traffic_filtering=True,id=955c1904-ccf7-4151-87fb-d1ae05d45056,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955c1904-cc')
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCWVOyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:12:59 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dcd7d28-e6b4-4fa6-a4c5-c68b0a4ad9eb', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70622fe3-d012-4f12-9b21-a3329d48a7e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad9fcb-c881-4c3c-9b57-92735dbcf188]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:59 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:12:59 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:12:59 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd5447271c0>, {}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Disconnecting from: [] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== disconnect_volume: return (53ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:12:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Deleting instance files /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee_del
Aug 26 18:12:59 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Deletion of /opt/stack/data/nova/instances/80a3ee08-e4dc-4174-a945-464b5df384ee_del complete
Aug 26 18:12:59 user nova-compute[73110]: INFO nova.compute.manager [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 18:12:59 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:12:59 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:13:00 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Took 0.86 seconds to deallocate network for instance.
Aug 26 18:13:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:00 user nova-compute[73110]: WARNING nova.volume.cinder [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Attachment 9542d319-9dfa-4bbd-af01-9d74cbb005a9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9542d319-9dfa-4bbd-af01-9d74cbb005a9. (HTTP 404) (Request-ID: req-dca4433f-7cf3-4bf5-8798-badf4e0a6022)
Aug 26 18:13:00 user nova-compute[73110]: INFO nova.compute.manager [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:00 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Deleted allocations for instance 80a3ee08-e4dc-4174-a945-464b5df384ee
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-a9361569-3221-4eed-9a61-94f0b7c2abff tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] Acquiring lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] Lock "80a3ee08-e4dc-4174-a945-464b5df384ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] No waiting events found dispatching network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:13:00 user nova-compute[73110]: WARNING nova.compute.manager [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received unexpected event network-vif-plugged-955c1904-ccf7-4151-87fb-d1ae05d45056 for instance with vm_state deleted and task_state None.
Aug 26 18:13:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-cd35c7de-009d-4082-b922-c042f7dbe427 req-21bafd6e-89f6-4d17-9bfe-5547c7c0424e service nova] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Received event network-vif-deleted-955c1904-ccf7-4151-87fb-d1ae05d45056 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing instance network info cache due to event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:13:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:13:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:13:02 user nova-compute[73110]: DEBUG nova.network.neutron [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:13:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updated VIF entry in instance network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:13:03 user nova-compute[73110]: DEBUG nova.network.neutron [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:13:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-6d3b385a-0ff5-4c12-ac85-204e1af3e6bd req-e8ac7377-23cd-4ceb-910b-da05edd6ae9d service nova] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:13:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:14 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073579.102332, 80a3ee08-e4dc-4174-a945-464b5df384ee => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:13:14 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] VM Stopped (Lifecycle Event)
Aug 26 18:13:14 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a78ec093-93f8-42ae-8ede-3f3c8186f881 None None] [instance: 80a3ee08-e4dc-4174-a945-464b5df384ee] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:13:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:16 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:13:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:13:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:13:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:13:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:13:19 user nova-compute[73110]: INFO nova.compute.claims [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Claim successful on node user
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:13:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:13:19 user nova-compute[73110]: INFO nova.virt.block_device [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Booting with volume 95db1310-a123-4015-aa50-4df373f17a09 at /dev/vda
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.policy [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd8e8d49429407ebe455d2d3a967ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bd13facc61422f933beabd7d82e2a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.utils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9453323-0330-41d1-b016-234fb49e9581]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c5459-9161-42d8-bb8a-6dbca912a1e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[145cee20-bb8f-485b-bd4a-701497e867c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe7fbed-aa43-4464-9385-636e43dfbd33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:13:19 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:13:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e086dc6-056d-4fe0-8e39-78367132a3f5]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG os_brick.utils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:13:19 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating existing volume attachment record: 06ca9e56-b492-4dc6-b9c7-895ba5c7435c {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:13:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Successfully created port: 50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Successfully updated port: 50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquired lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-changed-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing instance network info cache due to event network-changed-50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] Acquiring lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Releasing lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Instance network_info: |[{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] Acquired lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing network info cache for port 50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updated VIF entry in instance network info cache for port 50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:13:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-bc5be17b-4f26-4940-b296-60201105e0d7 req-65c6eb6a-c939-49f7-be32-9362b8eaa844 service nova] Releasing lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:13:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=25.109004974365234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9e5d6acf-aaa7-47e3-885b-6cd77995d45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:13:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:13:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Creating image(s)
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Ensure instance console log exists: /opt/stack/data/nova/instances/9e5d6acf-aaa7-47e3-885b-6cd77995d45b/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Start _get_guest_xml network_info=[{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '06ca9e56-b492-4dc6-b9c7-895ba5c7435c', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYUcqWsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e5d6acf-aaa7-47e3-885b-6cd77995d45b', 'attached_at': '', 'detached_at': '', 'volume_id': '95db1310-a123-4015-aa50-4df373f17a09', 'serial': '95db1310-a123-4015-aa50-4df373f17a09'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:13:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:13:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:13:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYUcqWsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:13:31 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:13:31 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:13:31 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50cc24-51bb-4384-b11b-3fe79e680fc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:13:31 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eadc1e-7626-4b07-a79c-6afac80d3259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09] added
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce270c2-1d03-413c-94d2-bb0025f1d0b3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5d221-e52b-4b6a-b0e1-d2279f8339df]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYUcqWsr {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYUcqWsr" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df75a90-2903-4cee-ae70-30ee996fc355]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYUcqWsr'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcd61a5-ae2d-433a-8b40-60aae96e8a26]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11c702-3b1d-4411-9d63-df25bf50ddd0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a73fe-d42d-4300-937c-25fe46aca4c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260]
Aug 26 18:13:31 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260] successful.
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f6cb1-c80c-4292-9fdb-2043ca4b1be7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101b513-b963-49ab-81f6-bf14086bfb84]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:13:31 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:13:31 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b9b166-38c4-41fe-b665-a0bb0f2a5ea8]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:13:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYUcqWsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26464386232333631', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464386232333631', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384848969',display_name='tempest-TestVolumeBootPattern-server-384848969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384848969',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-qnzn03mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:13:20Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=9e5d6acf-aaa7-47e3-885b-6cd77995d45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e5d6acf-aaa7-47e3-885b-6cd77995d45b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:13:32 user nova-compute[73110]:   <uuid>9e5d6acf-aaa7-47e3-885b-6cd77995d45b</uuid>
Aug 26 18:13:32 user nova-compute[73110]:   <name>instance-00000032</name>
Aug 26 18:13:32 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:13:32 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:13:32 user nova-compute[73110]:   <metadata>
Aug 26 18:13:32 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:13:32 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:13:32 user nova-compute[73110]:       <nova:name>tempest-TestVolumeBootPattern-server-384848969</nova:name>
Aug 26 18:13:32 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:13:30</nova:creationTime>
Aug 26 18:13:32 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:13:32 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:13:32 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:13:32 user nova-compute[73110]:       <nova:owner>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:user uuid="5fd8e8d49429407ebe455d2d3a967ab6">tempest-TestVolumeBootPattern-2126809828-project-member</nova:user>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:project uuid="a6bd13facc61422f933beabd7d82e2a6">tempest-TestVolumeBootPattern-2126809828</nova:project>
Aug 26 18:13:32 user nova-compute[73110]:       </nova:owner>
Aug 26 18:13:32 user nova-compute[73110]:       <nova:ports>
Aug 26 18:13:32 user nova-compute[73110]:         <nova:port uuid="50496188-6393-42a7-a100-182f212c6197">
Aug 26 18:13:32 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 18:13:32 user nova-compute[73110]:         </nova:port>
Aug 26 18:13:32 user nova-compute[73110]:       </nova:ports>
Aug 26 18:13:32 user nova-compute[73110]:     </nova:instance>
Aug 26 18:13:32 user nova-compute[73110]:   </metadata>
Aug 26 18:13:32 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:13:32 user nova-compute[73110]:     <system>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="serial">9e5d6acf-aaa7-47e3-885b-6cd77995d45b</entry>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="uuid">9e5d6acf-aaa7-47e3-885b-6cd77995d45b</entry>
Aug 26 18:13:32 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:13:32 user nova-compute[73110]:     </system>
Aug 26 18:13:32 user nova-compute[73110]:   </sysinfo>
Aug 26 18:13:32 user nova-compute[73110]:   <os>
Aug 26 18:13:32 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:13:32 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:13:32 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:13:32 user nova-compute[73110]:   </os>
Aug 26 18:13:32 user nova-compute[73110]:   <features>
Aug 26 18:13:32 user nova-compute[73110]:     <acpi/>
Aug 26 18:13:32 user nova-compute[73110]:     <apic/>
Aug 26 18:13:32 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:13:32 user nova-compute[73110]:   </features>
Aug 26 18:13:32 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:13:32 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:13:32 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:13:32 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:13:32 user nova-compute[73110]:   </clock>
Aug 26 18:13:32 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:13:32 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:13:32 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:13:32 user nova-compute[73110]:   </cpu>
Aug 26 18:13:32 user nova-compute[73110]:   <devices>
Aug 26 18:13:32 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:13:32 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:13:32 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 18:13:32 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:13:32 user nova-compute[73110]:       <serial>95db1310-a123-4015-aa50-4df373f17a09</serial>
Aug 26 18:13:32 user nova-compute[73110]:     </disk>
Aug 26 18:13:32 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:13:32 user nova-compute[73110]:       <mac address="fa:16:3e:af:f8:b6"/>
Aug 26 18:13:32 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:13:32 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:13:32 user nova-compute[73110]:       <target dev="tap50496188-63"/>
Aug 26 18:13:32 user nova-compute[73110]:     </interface>
Aug 26 18:13:32 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:13:32 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/9e5d6acf-aaa7-47e3-885b-6cd77995d45b/console.log" append="off"/>
Aug 26 18:13:32 user nova-compute[73110]:     </serial>
Aug 26 18:13:32 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:13:32 user nova-compute[73110]:     <video>
Aug 26 18:13:32 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:13:32 user nova-compute[73110]:     </video>
Aug 26 18:13:32 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:13:32 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:13:32 user nova-compute[73110]:     </rng>
Aug 26 18:13:32 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:13:32 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:13:32 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:13:32 user nova-compute[73110]:     </memballoon>
Aug 26 18:13:32 user nova-compute[73110]:   </devices>
Aug 26 18:13:32 user nova-compute[73110]: </domain>
Aug 26 18:13:32 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384848969',display_name='tempest-TestVolumeBootPattern-server-384848969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384848969',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-qnzn03mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:13:20Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=9e5d6acf-aaa7-47e3-885b-6cd77995d45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG os_vif [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50496188-63, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50496188-63, col_values=(('external_ids', {'iface-id': '50496188-6393-42a7-a100-182f212c6197', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:f8:b6', 'vm-uuid': '9e5d6acf-aaa7-47e3-885b-6cd77995d45b'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:32 user nova-compute[73110]: INFO os_vif [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63')
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:13:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] No VIF found with MAC fa:16:3e:af:f8:b6, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] No waiting events found dispatching network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:13:33 user nova-compute[73110]: WARNING nova.compute.manager [req-e4dc6acc-6f91-420a-96c0-c81020f8f139 req-76d92cc5-29f6-4ebb-81ba-34f3b6645472 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received unexpected event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 for instance with vm_state building and task_state spawning.
Aug 26 18:13:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073615.8061702, 9e5d6acf-aaa7-47e3-885b-6cd77995d45b => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] VM Resumed (Lifecycle Event)
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Instance spawned successfully.
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073615.8063989, 9e5d6acf-aaa7-47e3-885b-6cd77995d45b => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] VM Started (Lifecycle Event)
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:13:35 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] No waiting events found dispatching network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:13:35 user nova-compute[73110]: WARNING nova.compute.manager [req-7836296a-6d3b-4125-902d-155642ebadc0 req-bea37ebd-57ae-45fb-98b4-3fff450bf36b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received unexpected event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 for instance with vm_state building and task_state spawning.
Aug 26 18:13:36 user nova-compute[73110]: INFO nova.compute.manager [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Took 16.70 seconds to build instance.
Aug 26 18:13:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e1251577-05e4-41e0-942b-16a91fc65328 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.792s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:13:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:13:51 user nova-compute[73110]: INFO nova.compute.manager [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Attaching volume c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 to /dev/vdb
Aug 26 18:13:51 user nova-compute[73110]: DEBUG os_brick.utils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de4ed9b-eca6-461e-bb43-08ff60c5e584]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a43a70-8be3-447e-b6f1-1ff6a8f7320a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c411dbc-ee4c-40fd-870f-4b381e9d320b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bfe3a5-675a-43d3-9399-06e74c6e03b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:13:52 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:13:52 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac785d8-6f45-4e81-a007-454a1a165a17]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG os_brick.utils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating existing volume attachment record: 6c5478f6-1d36-4c87-962a-c3980c251aa4 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:13:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:13:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:14:03 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:03 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:03 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc305f-aa77-4230-a907-0fe47a5206e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:14:03 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f01e36-8fd8-4172-8ab8-786dc47bae5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7] added
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b8e4b-cd28-4d0b-bd3b-fe5862d48f6a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f910d3-f8c9-4678-99b1-d2e7c32447c2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHbwNsvC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHbwNsvC" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691a7e4-599a-4837-999b-bece43b45a6a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hHbwNsvC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba560be-e799-4ca3-8eed-6da8ea967d1d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[778fa5ac-fcb5-466c-a83b-fbf45c76275b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06a6af-399d-47af-986f-b30ab7cfbdcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]
Aug 26 18:14:03 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a724cba-aee8-4cd7-b3a2-587c4c808358]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8d89a-54c5-4d45-ac29-bbb8bba0f25c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:03 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8345b-1ea2-4659-b29f-4ab7cf97c85a]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:03 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26664393835633432', 'path': '/dev/sde'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664393835633432', 'path': '/dev/sde'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:14:04 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:14:04 user nova-compute[73110]:   <source dev="/dev/sde"/>
Aug 26 18:14:04 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:14:04 user nova-compute[73110]:   <serial>c3c5eb8f-3e55-4352-8163-74d4ffdb16c7</serial>
Aug 26 18:14:04 user nova-compute[73110]: </disk>
Aug 26 18:14:04 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:14:04 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No VIF found with MAC fa:16:3e:12:f8:94, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:14:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7ad3c8d-d62a-40e2-8bfb-be812a261259 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.166s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing instance network info cache due to event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:17 user nova-compute[73110]: DEBUG nova.network.neutron [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated VIF entry in instance network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19d04d9e-7e45-47c0-b9c0-c53d5ad52a1a req-e916e0f8-82b5-4a88-9dcf-4209c9428c86 service nova] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing instance network info cache due to event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing instance network info cache due to event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated VIF entry in instance network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG nova.network.neutron [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ef10de4d-1f91-4ffd-8c4c-e8bdf2d9db35 req-56cb6527-9545-467e-a9a5-3f5c525f4027 service nova] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updated VIF entry in instance network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:21 user nova-compute[73110]: INFO nova.compute.manager [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Shelve offloading
Aug 26 18:14:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-f8a9e190-4cd4-4f1c-9dda-6f889abccad0 req-5fe726f8-c04f-4551-aefd-5d5e06340f11 service nova] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:21 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance destroyed successfully.
Aug 26 18:14:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:22 user nova-compute[73110]: WARNING nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state active and task_state shelving.
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:22 user nova-compute[73110]: WARNING nova.compute.manager [req-407d3d7a-05b6-4360-8685-d9f3327efb93 req-d3672ff1-f9ab-4f7f-bf7f-f72380aed74b service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state active and task_state shelving.
Aug 26 18:14:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.network.neutron [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:22 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:14:22 user nova-compute[73110]: INFO nova.compute.claims [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Claim successful on node user
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:14:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance destroyed successfully.
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'resources' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX1mVxuUTl23T8T0z27JxGhgKJiOnXE7xOwWSl5Tj6mr6fOnAZ+PVa05xUNPRuzC98FCxY4GKuQR4UDvLDNhzjBcAWWDIZthsP50nVaGl8LjPulWv/AClLmYE223GTOiA==',key_name='tempest-TestShelveInstance-235173116',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:12:44Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_vif [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb7b3a2a-e2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:23 user nova-compute[73110]: INFO os_vif [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2')
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:14:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing instance network info cache due to event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.network.neutron [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836c2d9-c1fb-4c01-b079-2b662032c097]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb4cf4-a6ef-4b62-87b9-0c31b4da37c2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54457c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6803b52d-cc8f-4f91-a89b-9f9d1b2f8dfe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46b06a-bc1a-4031-9110-e9777665299c]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c020dcc-1c66-48f2-9ea9-5fa032a306f7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.policy [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce8efb97268b45a1bb25476811227005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1797759abd6a48af86ab7feb4d1aed41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:14:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Creating image(s)
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "/opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "/opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "/opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[76617c19-40b7-442f-85f5-11e733a8e398]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45bce3-1ae9-4129-ae65-36141b263d69]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1ef31-40d0-480b-b037-9baf904fd895]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]
Aug 26 18:14:23 user nova-compute[73110]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:14:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[def16373-0e07-4c6b-b470-2b1cd7669ebb]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== disconnect_volume: return (364ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:14:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deleting instance files /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5_del
Aug 26 18:14:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deletion of /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5_del complete
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.186s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.189s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updated VIF entry in instance network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": null, "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk 1073741824" returned: 0 in 0.067s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a92b58f0-0e03-4d6d-89cd-097c2dcec122 req-403523d1-1ee2-4e17-8867-3c226489c0be service nova] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.217s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Successfully created port: 69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Cannot resize image /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Ensure instance console log exists: /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:14:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Successfully updated port: 69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:14:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=25.097789764404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquired lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:14:25 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Deleted allocations for instance 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 9e5d6acf-aaa7-47e3-885b-6cd77995d45b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.190s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-changed-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Refreshing instance network info cache due to event network-changed-69f8a950-6aa0-4e40-aa87-44c41b6a8207. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] Acquiring lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.objects.base [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Object Instance<85b174a3-711e-4f66-a2ea-4d3d5a8c54d5> lazy-loaded attributes: resources,numa_topology {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c7954630-cadc-4853-952e-9ad91aa8dae9 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.768s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updating instance_info_cache with network_info: [{"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Releasing lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Instance network_info: |[{"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] Acquired lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.neutron [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Refreshing network info cache for port 69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Start _get_guest_xml network_info=[{"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:14:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-375670116',display_name='tempest-VolumesSnapshotTestJSON-instance-375670116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-375670116',id=51,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Lui9nYp+AeeN3g4xzBXAqcNOL/UL2Uuob+7D1Skc9t17OpIRUcXCfpm9tbg61T4Za4gvhDoKKlDaZXQaWWHGeBAT6akwwz5qqitCSEZ1huJ8+lAV2DKHXvxnyFB5L3Q==',key_name='tempest-keypair-2000422798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-0b31nzbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=dba01b7b-733f-404d-a9fb-6d0e67d12a36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'pci_devices' on Instance uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:14:25 user nova-compute[73110]:   <uuid>dba01b7b-733f-404d-a9fb-6d0e67d12a36</uuid>
Aug 26 18:14:25 user nova-compute[73110]:   <name>instance-00000033</name>
Aug 26 18:14:25 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:14:25 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:14:25 user nova-compute[73110]:   <metadata>
Aug 26 18:14:25 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:14:25 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-375670116</nova:name>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:14:25</nova:creationTime>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:14:25 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:14:25 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:owner>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:user uuid="ce8efb97268b45a1bb25476811227005">tempest-VolumesSnapshotTestJSON-872819359-project-member</nova:user>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:project uuid="1797759abd6a48af86ab7feb4d1aed41">tempest-VolumesSnapshotTestJSON-872819359</nova:project>
Aug 26 18:14:25 user nova-compute[73110]:       </nova:owner>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:14:25 user nova-compute[73110]:       <nova:ports>
Aug 26 18:14:25 user nova-compute[73110]:         <nova:port uuid="69f8a950-6aa0-4e40-aa87-44c41b6a8207">
Aug 26 18:14:25 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 18:14:25 user nova-compute[73110]:         </nova:port>
Aug 26 18:14:25 user nova-compute[73110]:       </nova:ports>
Aug 26 18:14:25 user nova-compute[73110]:     </nova:instance>
Aug 26 18:14:25 user nova-compute[73110]:   </metadata>
Aug 26 18:14:25 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:14:25 user nova-compute[73110]:     <system>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="serial">dba01b7b-733f-404d-a9fb-6d0e67d12a36</entry>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="uuid">dba01b7b-733f-404d-a9fb-6d0e67d12a36</entry>
Aug 26 18:14:25 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:14:25 user nova-compute[73110]:     </system>
Aug 26 18:14:25 user nova-compute[73110]:   </sysinfo>
Aug 26 18:14:25 user nova-compute[73110]:   <os>
Aug 26 18:14:25 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:14:25 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:14:25 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:14:25 user nova-compute[73110]:   </os>
Aug 26 18:14:25 user nova-compute[73110]:   <features>
Aug 26 18:14:25 user nova-compute[73110]:     <acpi/>
Aug 26 18:14:25 user nova-compute[73110]:     <apic/>
Aug 26 18:14:25 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:14:25 user nova-compute[73110]:   </features>
Aug 26 18:14:25 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:14:25 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:14:25 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:14:25 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:14:25 user nova-compute[73110]:   </clock>
Aug 26 18:14:25 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:14:25 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:14:25 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:14:25 user nova-compute[73110]:   </cpu>
Aug 26 18:14:25 user nova-compute[73110]:   <devices>
Aug 26 18:14:25 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:14:25 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:14:25 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk"/>
Aug 26 18:14:25 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:14:25 user nova-compute[73110]:     </disk>
Aug 26 18:14:25 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:14:25 user nova-compute[73110]:       <mac address="fa:16:3e:b5:42:20"/>
Aug 26 18:14:25 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:14:25 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:14:25 user nova-compute[73110]:       <target dev="tap69f8a950-6a"/>
Aug 26 18:14:25 user nova-compute[73110]:     </interface>
Aug 26 18:14:25 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:14:25 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/console.log" append="off"/>
Aug 26 18:14:25 user nova-compute[73110]:     </serial>
Aug 26 18:14:25 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:14:25 user nova-compute[73110]:     <video>
Aug 26 18:14:25 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:14:25 user nova-compute[73110]:     </video>
Aug 26 18:14:25 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:14:25 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:14:25 user nova-compute[73110]:     </rng>
Aug 26 18:14:25 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:14:25 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:14:25 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:14:25 user nova-compute[73110]:     </memballoon>
Aug 26 18:14:25 user nova-compute[73110]:   </devices>
Aug 26 18:14:25 user nova-compute[73110]: </domain>
Aug 26 18:14:25 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-375670116',display_name='tempest-VolumesSnapshotTestJSON-instance-375670116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-375670116',id=51,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Lui9nYp+AeeN3g4xzBXAqcNOL/UL2Uuob+7D1Skc9t17OpIRUcXCfpm9tbg61T4Za4gvhDoKKlDaZXQaWWHGeBAT6akwwz5qqitCSEZ1huJ8+lAV2DKHXvxnyFB5L3Q==',key_name='tempest-keypair-2000422798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-0b31nzbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=dba01b7b-733f-404d-a9fb-6d0e67d12a36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG os_vif [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f8a950-6a, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69f8a950-6a, col_values=(('external_ids', {'iface-id': '69f8a950-6aa0-4e40-aa87-44c41b6a8207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:42:20', 'vm-uuid': 'dba01b7b-733f-404d-a9fb-6d0e67d12a36'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:26 user nova-compute[73110]: INFO os_vif [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a')
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No VIF found with MAC fa:16:3e:b5:42:20, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updated VIF entry in instance network info cache for port 69f8a950-6aa0-4e40-aa87-44c41b6a8207. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG nova.network.neutron [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updating instance_info_cache with network_info: [{"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-87331509-82da-42ba-9563-3067ef8f0f50 req-8bfc1198-b335-4d49-a7f5-1c0d1c8aa69f service nova] Releasing lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] No waiting events found dispatching network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:27 user nova-compute[73110]: WARNING nova.compute.manager [req-160dfa0e-31c3-4759-b75e-6e8e32d598cf req-bff2a61e-e5ee-45a1-afe3-02036a4e1c60 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received unexpected event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 for instance with vm_state building and task_state spawning.
Aug 26 18:14:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:28 user nova-compute[73110]: INFO nova.compute.manager [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Rebooting instance
Aug 26 18:14:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:14:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:14:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.network.neutron [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073669.5675457, dba01b7b-733f-404d-a9fb-6d0e67d12a36 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] VM Resumed (Lifecycle Event)
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Instance spawned successfully.
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073669.5697744, dba01b7b-733f-404d-a9fb-6d0e67d12a36 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] VM Started (Lifecycle Event)
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] No waiting events found dispatching network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:29 user nova-compute[73110]: WARNING nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received unexpected event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 for instance with vm_state building and task_state spawning.
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:29 user nova-compute[73110]: DEBUG nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:29 user nova-compute[73110]: WARNING nova.compute.manager [req-ea8624bc-074a-4a53-8fac-968b7558bd90 req-1f3d0cad-4b58-4b67-bd72-15c5c993918f service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 18:14:29 user nova-compute[73110]: INFO nova.compute.manager [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Took 6.90 seconds to build instance.
Aug 26 18:14:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-b298b735-bc31-41e5-bcd7-87927a5bf67e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:30 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance destroyed successfully.
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'resources' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:14:29Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap033c43b5-ad, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:30 user nova-compute[73110]: INFO os_vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad')
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:14:30 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[28575f59-df12-4d85-8632-ecf25a93c42a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3df0f21-d341-4e84-8edf-cd759b6c9732]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e24a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'): ({'sde'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Removing single pathed devices sde {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab153c2-9f52-4146-a6c3-9a04dec614b8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0813304f-b9ba-41b7-ba35-eb958e0be44f]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flushing IO for device /dev/sde {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7996ea89-3c9b-433f-93ba-d0b9df5377a1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[299d4699-3251-4ba2-9eef-2cf28254ae47]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] SCSI volumes sde have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7de7b3-e7f5-40bb-a90c-f1abd1018d35]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0beefb-d6b8-4b7d-ab46-d1ea05d5ba72]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]
Aug 26 18:14:30 user nova-compute[73110]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab464b-6867-4190-8191-bb7939c2d049]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== disconnect_volume: return (266ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start _get_guest_xml network_info=[{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=842052f8-a7ab-4aba-a695-ee23d2043c41,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '842052f8-a7ab-4aba-a695-ee23d2043c41'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6c5478f6-1d36-4c87-962a-c3980c251aa4', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '63e267f9-e38d-4b07-b076-b4e76ccc5aff', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3c5eb8f-3e55-4352-8163-74d4ffdb16c7', 'serial': 'c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:14:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=842052f8-a7ab-4aba-a695-ee23d2043c41,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.objects.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Object Instance<63e267f9-e38d-4b07-b076-b4e76ccc5aff> lazy-loaded attributes: resources,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:14:30 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:30 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:14:30 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[645009c1-2247-45cc-8349-fab139383c97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:14:30 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[639b7963-19fd-4adc-82b8-fe8fcc82a162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7] added
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb093f12-1b40-4fc5-8130-5913b28594ba]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca5255f-7a99-41a1-abc0-9bfc36292775]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHbwNsvC {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHbwNsvC" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dc2499-b997-44f2-a739-3ea0c93b5eb9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hHbwNsvC'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9870609-2d51-47fb-b92a-ba0a1e7ee290]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[27066b67-cfa6-46eb-9893-3bb06d848c83]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e44fc-6d5a-43d7-a825-cdbbc6e8b998]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]
Aug 26 18:14:30 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f13cd-68b9-4a67-9543-91c675031075]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[31730211-0b02-4d09-a8a8-1ecc115616de]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:14:30 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b03476-acc3-4962-bd1c-a630ff8c743d]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:14:30 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.compute.manager [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:31 user nova-compute[73110]: WARNING nova.compute.manager [req-19f8c9e4-fb0c-4014-9189-92d6e93196de req-38e7afce-467b-45af-8540-cc0a424bebbe service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 18:14:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26664393835633432', 'path': '/dev/sdd'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664393835633432', 'path': '/dev/sdd'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:14:29Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'pci_devices' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.objects.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Object Instance<63e267f9-e38d-4b07-b076-b4e76ccc5aff> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:14:31 user nova-compute[73110]:   <uuid>63e267f9-e38d-4b07-b076-b4e76ccc5aff</uuid>
Aug 26 18:14:31 user nova-compute[73110]:   <name>instance-00000030</name>
Aug 26 18:14:31 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:14:31 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:14:31 user nova-compute[73110]:   <metadata>
Aug 26 18:14:31 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:14:31 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:name>tempest-TestMinimumBasicScenario-server-1669295859</nova:name>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:14:30</nova:creationTime>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:14:31 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:14:31 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:owner>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:user uuid="2359790ef72c447681b40e1548d1d2f2">tempest-TestMinimumBasicScenario-51070138-project-member</nova:user>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:project uuid="9330d1982ea343b691f895aeddde36db">tempest-TestMinimumBasicScenario-51070138</nova:project>
Aug 26 18:14:31 user nova-compute[73110]:       </nova:owner>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:root type="image" uuid="842052f8-a7ab-4aba-a695-ee23d2043c41"/>
Aug 26 18:14:31 user nova-compute[73110]:       <nova:ports>
Aug 26 18:14:31 user nova-compute[73110]:         <nova:port uuid="033c43b5-ad80-45a8-a57a-e5bd6cf76b92">
Aug 26 18:14:31 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 18:14:31 user nova-compute[73110]:         </nova:port>
Aug 26 18:14:31 user nova-compute[73110]:       </nova:ports>
Aug 26 18:14:31 user nova-compute[73110]:     </nova:instance>
Aug 26 18:14:31 user nova-compute[73110]:   </metadata>
Aug 26 18:14:31 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:14:31 user nova-compute[73110]:     <system>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="serial">63e267f9-e38d-4b07-b076-b4e76ccc5aff</entry>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="uuid">63e267f9-e38d-4b07-b076-b4e76ccc5aff</entry>
Aug 26 18:14:31 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:14:31 user nova-compute[73110]:     </system>
Aug 26 18:14:31 user nova-compute[73110]:   </sysinfo>
Aug 26 18:14:31 user nova-compute[73110]:   <os>
Aug 26 18:14:31 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:14:31 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:14:31 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:14:31 user nova-compute[73110]:   </os>
Aug 26 18:14:31 user nova-compute[73110]:   <features>
Aug 26 18:14:31 user nova-compute[73110]:     <acpi/>
Aug 26 18:14:31 user nova-compute[73110]:     <apic/>
Aug 26 18:14:31 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:14:31 user nova-compute[73110]:   </features>
Aug 26 18:14:31 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:14:31 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:14:31 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:14:31 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:14:31 user nova-compute[73110]:   </clock>
Aug 26 18:14:31 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:14:31 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:14:31 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:14:31 user nova-compute[73110]:   </cpu>
Aug 26 18:14:31 user nova-compute[73110]:   <devices>
Aug 26 18:14:31 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:14:31 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:14:31 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk"/>
Aug 26 18:14:31 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:14:31 user nova-compute[73110]:     </disk>
Aug 26 18:14:31 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:14:31 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:14:31 user nova-compute[73110]:       <source dev="/dev/sdd"/>
Aug 26 18:14:31 user nova-compute[73110]:       <target dev="vdb" bus="virtio"/>
Aug 26 18:14:31 user nova-compute[73110]:       <serial>c3c5eb8f-3e55-4352-8163-74d4ffdb16c7</serial>
Aug 26 18:14:31 user nova-compute[73110]:     </disk>
Aug 26 18:14:31 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:14:31 user nova-compute[73110]:       <mac address="fa:16:3e:12:f8:94"/>
Aug 26 18:14:31 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:14:31 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:14:31 user nova-compute[73110]:       <target dev="tap033c43b5-ad"/>
Aug 26 18:14:31 user nova-compute[73110]:     </interface>
Aug 26 18:14:31 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:14:31 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/console.log" append="off"/>
Aug 26 18:14:31 user nova-compute[73110]:     </serial>
Aug 26 18:14:31 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:14:31 user nova-compute[73110]:     <video>
Aug 26 18:14:31 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:14:31 user nova-compute[73110]:     </video>
Aug 26 18:14:31 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:14:31 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:14:31 user nova-compute[73110]:     </rng>
Aug 26 18:14:31 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:14:31 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:14:31 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:14:31 user nova-compute[73110]:     </memballoon>
Aug 26 18:14:31 user nova-compute[73110]:   </devices>
Aug 26 18:14:31 user nova-compute[73110]: </domain>
Aug 26 18:14:31 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:14:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.objects.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Object Instance<63e267f9-e38d-4b07-b076-b4e76ccc5aff> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0 --force-share --output=json" returned: 0 in 0.182s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Cannot resize image /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'migration_context' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.objects.base [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Object Instance<63e267f9-e38d-4b07-b076-b4e76ccc5aff> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:14:29Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG os_vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap033c43b5-ad, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap033c43b5-ad, col_values=(('external_ids', {'iface-id': '033c43b5-ad80-45a8-a57a-e5bd6cf76b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:f8:94', 'vm-uuid': '63e267f9-e38d-4b07-b076-b4e76ccc5aff'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:14:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:32 user nova-compute[73110]: INFO os_vif [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad')
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG nova.compute.manager [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:34 user nova-compute[73110]: WARNING nova.compute.manager [req-11facffb-d344-462d-8e38-3dbcd4b7e361 req-044affcf-4663-4753-b0cc-f5614975d890 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 63e267f9-e38d-4b07-b076-b4e76ccc5aff due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073676.2940536, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:14:36 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] VM Resumed (Lifecycle Event)
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:14:36 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance rebooted successfully.
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:14:36 user nova-compute[73110]: WARNING nova.compute.manager [req-0e3409f7-5708-4a1f-85cc-91420f379b1e req-75740a8e-6ad3-4c24-888d-57c866c55607 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 18:14:36 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073676.303665, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:14:36 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] VM Started (Lifecycle Event)
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0e4663f9-e440-4a97-8d5f-ab8a910a8eea tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.703s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073661.8517268, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:14:36 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Stopped (Lifecycle Event)
Aug 26 18:14:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-99c2163f-221e-4eb1-b848-8b4df87f8da3 None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:14:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:14:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-changed-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing instance network info cache due to event network-changed-50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] Acquiring lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] Acquired lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing network info cache for port 50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updated VIF entry in instance network info cache for port 50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-19ab0319-826e-417b-bdcc-0a666487230c req-571c6484-c00a-447a-9fce-06b49a84db0b service nova] Releasing lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-changed-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.compute.manager [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing instance network info cache due to event network-changed-50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] Acquiring lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] Acquired lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:15:12 user nova-compute[73110]: DEBUG nova.network.neutron [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Refreshing network info cache for port 50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:13 user nova-compute[73110]: INFO nova.compute.manager [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Terminating instance
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.compute.manager [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-unplugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] No waiting events found dispatching network-vif-unplugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-30e7ed0b-dd75-439f-a126-f652f4eeebed req-21e8584b-b829-43f5-92bb-8949013c22dc service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-unplugged-50496188-6393-42a7-a100-182f212c6197 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updated VIF entry in instance network info cache for port 50496188-6393-42a7-a100-182f212c6197. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [{"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32fe994d-c46a-4f83-826a-1e176ee98bf3 req-8ca7a798-b43a-4180-927a-c2ababdbcaa9 service nova] Releasing lock "refresh_cache-9e5d6acf-aaa7-47e3-885b-6cd77995d45b" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Instance destroyed successfully.
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.objects.instance [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid 9e5d6acf-aaa7-47e3-885b-6cd77995d45b {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-384848969',display_name='tempest-TestVolumeBootPattern-server-384848969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-384848969',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-qnzn03mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:13:36Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=9e5d6acf-aaa7-47e3-885b-6cd77995d45b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "50496188-6393-42a7-a100-182f212c6197", "address": "fa:16:3e:af:f8:b6", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50496188-63", "ovs_interfaceid": "50496188-6393-42a7-a100-182f212c6197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_vif [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50496188-63, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:13 user nova-compute[73110]: INFO os_vif [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:f8:b6,bridge_name='br-int',has_traffic_filtering=True,id=50496188-6393-42a7-a100-182f212c6197,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50496188-63')
Aug 26 18:15:13 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYUcqWsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:15:13 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e09653d-797f-48ea-8cd8-9a90ef283769]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e625420-2072-43a8-bdcf-019a4d3eb085]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:15:13 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd573bd2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a816088f-a57e-43a4-9cc8-134d9970ae66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b6422-6044-4ba2-9a8c-7b51edc10d4a]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f151a7-37d4-4929-bfa7-c085ca60a1fa]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df4e82-cad7-45a1-9286-d77d0bf0004b]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358dcba-6ac4-4d29-9195-fad56dc67811]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:15:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d2910-01de-4ce5-a0f9-2469007433f3]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260]
Aug 26 18:15:14 user nova-compute[73110]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09, portal: 172.16.0.220,3260] successful.
Aug 26 18:15:14 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95db1310-a123-4015-aa50-4df373f17a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ecc7a0-b753-47ef-842d-2934cfc5d364]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (274ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:15:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Deleting instance files /opt/stack/data/nova/instances/9e5d6acf-aaa7-47e3-885b-6cd77995d45b_del
Aug 26 18:15:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Deletion of /opt/stack/data/nova/instances/9e5d6acf-aaa7-47e3-885b-6cd77995d45b_del complete
Aug 26 18:15:14 user nova-compute[73110]: INFO nova.compute.manager [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 18:15:14 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-19eefcc3-4290-471e-abd7-104f179d30f8 req-6a7b6cdc-4045-4859-a1ed-8b9ba66dbaa4 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-deleted-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:15:14 user nova-compute[73110]: INFO nova.compute.manager [req-19eefcc3-4290-471e-abd7-104f179d30f8 req-6a7b6cdc-4045-4859-a1ed-8b9ba66dbaa4 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Neutron deleted interface 50496188-6393-42a7-a100-182f212c6197; detaching it from the instance and deleting it from the info cache
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-19eefcc3-4290-471e-abd7-104f179d30f8 req-6a7b6cdc-4045-4859-a1ed-8b9ba66dbaa4 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:15:14 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Took 0.58 seconds to deallocate network for instance.
Aug 26 18:15:14 user nova-compute[73110]: DEBUG nova.compute.manager [req-19eefcc3-4290-471e-abd7-104f179d30f8 req-6a7b6cdc-4045-4859-a1ed-8b9ba66dbaa4 service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Detach interface failed, port_id=50496188-6393-42a7-a100-182f212c6197, reason: Instance 9e5d6acf-aaa7-47e3-885b-6cd77995d45b could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] Acquiring lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG nova.compute.manager [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] No waiting events found dispatching network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:15:15 user nova-compute[73110]: WARNING nova.compute.manager [req-2a4e2cd8-f3de-4ea2-aff7-7226bd6701b8 req-dcb44abc-21a6-4601-b9ab-7bf5ee955f9d service nova] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Received unexpected event network-vif-plugged-50496188-6393-42a7-a100-182f212c6197 for instance with vm_state active and task_state deleting.
Aug 26 18:15:15 user nova-compute[73110]: INFO nova.compute.manager [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Took 0.74 seconds to detach 1 volumes for instance.
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:15 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance 9e5d6acf-aaa7-47e3-885b-6cd77995d45b
Aug 26 18:15:15 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-44083d0b-f302-4541-846f-8749b4873760 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "9e5d6acf-aaa7-47e3-885b-6cd77995d45b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:15:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:19 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid b64db151-bb30-44d4-b9c9-51e88b0ecbe5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:15:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:15:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:15:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:15:25 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=25.067127227783203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:15:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:28 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073713.7618213, 9e5d6acf-aaa7-47e3-885b-6cd77995d45b => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:15:28 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] VM Stopped (Lifecycle Event)
Aug 26 18:15:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5bc146d7-c751-486d-9acc-46ea0e79059f None None] [instance: 9e5d6acf-aaa7-47e3-885b-6cd77995d45b] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:15:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:38 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:43 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Verify base images {{(pid=73110) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Image id 4299a158-616a-46c3-b665-9d8a5d47a509 yields fingerprint f608f0f717d580f5a680fa6ac49f2ea8b85725bd {{(pid=73110) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] image 4299a158-616a-46c3-b665-9d8a5d47a509 at (/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd): checking
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] image 4299a158-616a-46c3-b665-9d8a5d47a509 at (/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd): image is in use {{(pid=73110) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73110) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Image id 842052f8-a7ab-4aba-a695-ee23d2043c41 yields fingerprint 9f4ea44252143a054e4519d7623e726c5620a2f0 {{(pid=73110) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] image 842052f8-a7ab-4aba-a695-ee23d2043c41 at (/opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0): checking
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] image 842052f8-a7ab-4aba-a695-ee23d2043c41 at (/opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0): image is in use {{(pid=73110) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] b64db151-bb30-44d4-b9c9-51e88b0ecbe5 is a valid instance name {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] 63e267f9-e38d-4b07-b076-b4e76ccc5aff is a valid instance name {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] 63e267f9-e38d-4b07-b076-b4e76ccc5aff has a disk file {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff is backed by 9f4ea44252143a054e4519d7623e726c5620a2f0 {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] dba01b7b-733f-404d-a9fb-6d0e67d12a36 is a valid instance name {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] dba01b7b-733f-404d-a9fb-6d0e67d12a36 has a disk file {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 is backed by f608f0f717d580f5a680fa6ac49f2ea8b85725bd {{(pid=73110) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c
Aug 26 18:15:45 user nova-compute[73110]: WARNING nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Unknown base file: /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Active base files: /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd /opt/stack/data/nova/instances/_base/9f4ea44252143a054e4519d7623e726c5620a2f0
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Removable base files: /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9 /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1 /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42 /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d517b37aa25a88cfce0ca17084858e7ca851dea
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/adfe7a8fe41c7c3fc9cf4eb74bf1e33223a2fbe9
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f2a7f5b9d96674a1e7b7937b359ba41eb3b235fe
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6743389174b22b78fb51f1f562da4de6e2628ac1
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f34c8f2d2edad21b469dd1a1898afe016777a42
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f04615a7ecad70137522948372f2538f6ae84c3c
Aug 26 18:15:45 user nova-compute[73110]: INFO nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ef7a2c1e2296c4e2946619b151f38f5b6a789685
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Verification complete {{(pid=73110) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Verify swap images {{(pid=73110) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 18:15:45 user nova-compute[73110]: DEBUG nova.virt.libvirt.imagecache [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Verify ephemeral images {{(pid=73110) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 18:15:48 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:53 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:15:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:03 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:16:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:13 user nova-compute[73110]: INFO nova.compute.manager [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Unshelving
Aug 26 18:16:13 user nova-compute[73110]: INFO nova.virt.block_device [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Booting with volume 8fb12861-de40-4303-9671-6e1daa8d11eb at /dev/vda
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.utils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ebf24-38f9-452b-9ca6-c6731a7b2b91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779f579-81c8-486f-968b-07ded8f1a4c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf3365b-4076-4097-8b3f-078570b3b611]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11629656-a376-4e77-9e20-2a0766f784fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:16:13 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe2b18-c6b9-4129-8358-fd7d4446dbe2]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG os_brick.utils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating existing volume attachment record: f314e9c0-354a-421e-ba57-9f73a2c9a1e8 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-changed-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG nova.compute.manager [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Refreshing instance network info cache due to event network-changed-69f8a950-6aa0-4e40-aa87-44c41b6a8207. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] Acquiring lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] Acquired lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:13 user nova-compute[73110]: DEBUG nova.network.neutron [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Refreshing network info cache for port 69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:14 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Ignoring supplied device name: /dev/vdb
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:14 user nova-compute[73110]: INFO nova.compute.manager [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Attaching volume f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 to /dev/vdb
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.utils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5bca9-8838-4eb8-b58f-0c34502200e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83e508-042a-4e20-acb6-62a66f6299d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ff1810-570a-475a-bb7c-6f9e4975cdce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd36364-30c2-4f5c-9930-58de1c2b9383]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updated VIF entry in instance network info cache for port 69f8a950-6aa0-4e40-aa87-44c41b6a8207. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG nova.network.neutron [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updating instance_info_cache with network_info: [{"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:16:14 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b591e42-92ae-4f8d-9c18-e4486b5e2d1b]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG os_brick.utils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updating existing volume attachment record: 5bd5c652-a233-42bb-93c0-ab5df35cb46d {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:16:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-704b2d22-6060-4ebb-90c6-e05b9a8da45b req-d07f92d7-eb1d-4615-9011-cabd79562ac4 service nova] Releasing lock "refresh_cache-dba01b7b-733f-404d-a9fb-6d0e67d12a36" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG nova.compute.manager [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing instance network info cache due to event network-changed-f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] Acquiring lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] Acquired lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Refreshing network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:17 user nova-compute[73110]: INFO nova.compute.manager [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Terminating instance
Aug 26 18:16:17 user nova-compute[73110]: DEBUG nova.compute.manager [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:16:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-unplugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] No waiting events found dispatching network-vif-unplugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.compute.manager [req-86a2dae7-f3f7-4ebf-b0b0-e19841dc728a req-0d188104-94b1-4ec7-877d-06f925ee68bb service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-unplugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Instance destroyed successfully.
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.objects.instance [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lazy-loading 'resources' on Instance uuid b64db151-bb30-44d4-b9c9-51e88b0ecbe5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1001648231',display_name='tempest-TestVolumeBootPattern-server-1001648231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1001648231',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDazHQwE3gzY0Yor1dD/Q7tG+8VkSLUxUlZGYJl75lkcRg3OGGVcpYSM75l6iAM76/Xo7IsEa5Ia8IU390J66zEwoQDDwJa7HKJQhmX6gVU6a1d2eZUdfZJkHpzRqJw2uA==',key_name='tempest-TestVolumeBootPattern-1595607118',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6bd13facc61422f933beabd7d82e2a6',ramdisk_id='',reservation_id='r-bxlqejtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2126809828',owner_user_name='tempest-TestVolumeBootPattern-2126809828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:11:27Z,user_data=None,user_id='5fd8e8d49429407ebe455d2d3a967ab6',uuid=b64db151-bb30-44d4-b9c9-51e88b0ecbe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converting VIF {"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_vif [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3295ca9-aa, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:16:18 user nova-compute[73110]: INFO os_vif [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:44:96,bridge_name='br-int',has_traffic_filtering=True,id=f3295ca9-aa32-4a06-953c-4ef7145a2427,network=Network(19f944e4-aa2d-4cb1-b09f-dafc2da944cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3295ca9-aa')
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RESmxeas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:18 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdec723-9c56-4709-a1c0-71abc18fbd9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31d262-9949-422d-8010-ac2c071db389]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:16:18 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 (non-flash)
Aug 26 18:16:18 user nova-compute[73110]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e9e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941c93f-6f22-41e0-b493-418610a6883b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfefede8-14f0-4c4e-9d25-5ac7ee067b71]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951d0d0-50e0-464c-8280-279fb82dc62f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updated VIF entry in instance network info cache for port f3295ca9-aa32-4a06-953c-4ef7145a2427. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG nova.network.neutron [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [{"id": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "address": "fa:16:3e:fd:44:96", "network": {"id": "19f944e4-aa2d-4cb1-b09f-dafc2da944cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1889031524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6bd13facc61422f933beabd7d82e2a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3295ca9-aa", "ovs_interfaceid": "f3295ca9-aa32-4a06-953c-4ef7145a2427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-3e8cb1a7-005b-462b-97de-a8e2a43d7b1d req-bb902cf8-ebd7-46ca-b82d-20c0ecd32d81 service nova] Releasing lock "refresh_cache-b64db151-bb30-44d4-b9c9-51e88b0ecbe5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2058631f-7ce3-4965-86c1-d00e67318401]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO43560ac9-b0dfe8e79d28f541', '/dev/disk/by-id/scsi-26230646665386537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43560ac9') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1fda9e-6beb-46b1-a6f1-be88eea36291]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c115dac1-2ed4-4206-8888-d460f0add040]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7d8f6-12b0-446f-8cb0-4d07bfb270d2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260]
Aug 26 18:16:18 user nova-compute[73110]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347, portal: 172.16.0.220,3260] successful.
Aug 26 18:16:18 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:18 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba48cdfb-a8b5-4603-b77e-36e1a07e2347 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f892c99-7306-4722-90fb-505fdb2f6326]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] <== disconnect_volume: return (303ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:16:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Deleting instance files /opt/stack/data/nova/instances/b64db151-bb30-44d4-b9c9-51e88b0ecbe5_del
Aug 26 18:16:19 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Deletion of /opt/stack/data/nova/instances/b64db151-bb30-44d4-b9c9-51e88b0ecbe5_del complete
Aug 26 18:16:19 user nova-compute[73110]: INFO nova.compute.manager [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 18:16:19 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:16:19 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:20 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Took 1.21 seconds to deallocate network for instance.
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] Acquiring lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] No waiting events found dispatching network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:16:20 user nova-compute[73110]: WARNING nova.compute.manager [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received unexpected event network-vif-plugged-f3295ca9-aa32-4a06-953c-4ef7145a2427 for instance with vm_state active and task_state deleting.
Aug 26 18:16:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-101cd98f-4ba4-4beb-811a-a8f448bce606 req-840cff95-4d2b-4cf9-9725-b13a59313887 service nova] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Received event network-vif-deleted-f3295ca9-aa32-4a06-953c-4ef7145a2427 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:16:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing instance network info cache due to event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing instance network info cache due to event network-changed-033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] Acquiring lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated VIF entry in instance network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-10f88fdd-8416-421b-9b63-1b49c3b98f18 req-d3a32d97-c9a0-4a5f-9e35-199c4f6ea313 service nova] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] Acquired lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Refreshing network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:16:23 user nova-compute[73110]: DEBUG nova.network.neutron [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updated VIF entry in instance network info cache for port 033c43b5-ad80-45a8-a57a-e5bd6cf76b92. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:16:23 user nova-compute[73110]: DEBUG nova.network.neutron [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [{"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a60356a5-d0b6-4798-89a1-e9fc4d231ce2 req-d5318a9f-a741-4738-8810-334adba92d5b service nova] Releasing lock "refresh_cache-63e267f9-e38d-4b07-b076-b4e76ccc5aff" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'pci_requests' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:16:25 user nova-compute[73110]: INFO nova.compute.claims [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Claim successful on node user
Aug 26 18:16:25 user nova-compute[73110]: INFO nova.compute.manager [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Took 5.46 seconds to detach 1 volumes for instance.
Aug 26 18:16:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:25 user nova-compute[73110]: INFO nova.compute.manager [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Detaching volume c3c5eb8f-3e55-4352-8163-74d4ffdb16c7
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:16:25 user nova-compute[73110]: INFO nova.virt.block_device [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Attempting to driver detach volume c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 from mountpoint /dev/vdb
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Attempting to detach device vdb from instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:16:25 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:16:25 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 18:16:25 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:16:25 user nova-compute[73110]:   <serial>c3c5eb8f-3e55-4352-8163-74d4ffdb16c7</serial>
Aug 26 18:16:25 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 18:16:25 user nova-compute[73110]: </disk>
Aug 26 18:16:25 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:16:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully detached device vdb from instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff from the persistent domain config.
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:16:25 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:16:25 user nova-compute[73110]:   <source dev="/dev/sdd"/>
Aug 26 18:16:25 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:16:25 user nova-compute[73110]:   <serial>c3c5eb8f-3e55-4352-8163-74d4ffdb16c7</serial>
Aug 26 18:16:25 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 18:16:25 user nova-compute[73110]: </disk>
Aug 26 18:16:25 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:16:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpwCLFra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:26 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:26 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:26 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea9dd2-a9c7-4b7e-aaba-0d779443c90a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:16:26 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ee71d1-f9e8-47ef-98eb-3e7257ccec8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0] added
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.296s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[78009d67-abe1-4f8a-9e2b-7e9e59b91198]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f811cf-e92b-4e09-a212-2d1285172e95]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpwCLFra {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpwCLFra" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75179e-da55-45d4-a2ee-2d1e84615c55]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpwCLFra'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4908e-fee0-470b-89f1-fd1e601620f9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:26 user nova-compute[73110]: INFO nova.network.neutron [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating port db7b3a2a-e250-4dd9-a150-6884a7790104 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a951d-461c-4e95-9249-2948daae8837]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5511eff-f07a-435c-941d-e316a84a8091]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260]
Aug 26 18:16:26 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260] successful.
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a383c0d-03aa-4d3c-aec5-8d803264709e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.086s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b66b53-ca0c-4929-9bfa-449f562ad42f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:26 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073786.363601, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:16:26 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Deleted allocations for instance b64db151-bb30-44d4-b9c9-51e88b0ecbe5
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:16:26 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully detached device vdb from instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff from the live domain config.
Aug 26 18:16:26 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHbwNsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:26 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ee7f9-2700-43d0-a04e-b5025cf51f8f]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpwCLFra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-934a378e-d4f8-48b9-a9b7-9c2725e5e2d2 tempest-TestVolumeBootPattern-2126809828 tempest-TestVolumeBootPattern-2126809828-project-member] Lock "b64db151-bb30-44d4-b9c9-51e88b0ecbe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.563s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:26 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing instance network info cache due to event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== connect_volume: return (1573ms) {'type': 'block', 'scsi_wwn': '23864363435633136', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363435633136', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:16:27 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=25.065513610839844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6326da00-330f-40e7-9879-a4e692907a49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:16:27 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:16:27 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:16:27 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:16:27 user nova-compute[73110]:   <serial>f5d764b8-2e0b-4bca-9f27-ebfb52e619f0</serial>
Aug 26 18:16:27 user nova-compute[73110]: </disk>
Aug 26 18:16:27 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e6c1c-2707-492d-918e-091f06497b05]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:27 user nova-compute[73110]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 (non-flash)
Aug 26 18:16:27 user nova-compute[73110]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520ec7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7'): ({'sdd'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Removing single pathed devices sdd {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839e3c8-ec12-43a6-882f-9138d8ad4ba7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (166b0a1a-be79-4fde-8303-88dbbf28dbea): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad3728b-4185-46f1-8e7e-201f89c586e9]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flushing IO for device /dev/sdd {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77eceb8-f6a4-4315-accd-ddba67b57c47]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24752b5a-f27e-4a22-890b-949b8280875b]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] SCSI volumes sdd have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa5e8e-c77b-44d7-ad79-1cd9ed4848a9]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:16:27 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Creating image(s)
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Did not create local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Ensure instance console log exists: /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start _get_guest_xml network_info=[{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f314e9c0-354a-421e-ba57-9f73a2c9a1e8', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b174a3-711e-4f66-a2ea-4d3d5a8c54d5', 'attached_at': '', 'detached_at': '', 'volume_id': '8fb12861-de40-4303-9671-6e1daa8d11eb', 'serial': '8fb12861-de40-4303-9671-6e1daa8d11eb'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.network.neutron [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf359477-3961-40ac-ae1d-95a7278ba90d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260]
Aug 26 18:16:27 user nova-compute[73110]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7, portal: 172.16.0.220,3260] successful.
Aug 26 18:16:27 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:27 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:16:27 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c5eb8f-3e55-4352-8163-74d4ffdb16c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8ff4e-d009-488e-803e-fa6f4cfeafec]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== disconnect_volume: return (1570ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.objects.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Object Instance<85b174a3-711e-4f66-a2ea-4d3d5a8c54d5> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:16:27 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:27 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:16:27 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:16:27 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:16:27 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c9043-db83-4e2b-aae6-14d8f7936ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:16:28 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec612a-0a09-4343-832f-67e09351c678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb] added
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de30dbb-a89a-44fc-b1bd-ccd3610358d3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f7a048-7c9d-486d-8994-62a3ea551528]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMuavVHA {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] No VIF found with MAC fa:16:3e:b5:42:20, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMuavVHA" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922004a-a8c8-4bea-89b1-d1846a54ce38]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMuavVHA'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb268f-1fbb-474d-ae7f-ca91f3c0f36a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d455d17-df85-4d27-8c5d-7760ef989b4e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaff7c3-b9ad-4b45-bee4-c3ffd62480c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]
Aug 26 18:16:28 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e164e775-f86e-4606-b36f-c447d200dd1e tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.764s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b688f12-8829-4126-bb86-64a5d9581e15]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c84cf2-d562-4d67-b4d4-e1b36c4c4ea2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:28 user nova-compute[73110]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:16:28 user nova-compute[73110]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:16:28 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af6f06d-a70b-4897-82f5-3403ba297d97]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updated VIF entry in instance network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1dbd25aa-c50d-4ba1-9e5f-79af0078d4a4 req-18beb06b-68e3-449b-94a8-93d52f99dc12 service nova] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d3bab8ef-48cd-4fd2-9bd5-7787bae564a1 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.022s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23538626661363239', 'path': '/dev/sdc'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538626661363239', 'path': '/dev/sdc'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-235173116',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:16:13Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.objects.instance [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.objects.base [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Object Instance<85b174a3-711e-4f66-a2ea-4d3d5a8c54d5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73110) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:16:29 user nova-compute[73110]:   <uuid>85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</uuid>
Aug 26 18:16:29 user nova-compute[73110]:   <name>instance-00000031</name>
Aug 26 18:16:29 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:16:29 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:16:29 user nova-compute[73110]:   <metadata>
Aug 26 18:16:29 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:16:29 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:16:29 user nova-compute[73110]:       <nova:name>tempest-TestShelveInstance-server-889878797</nova:name>
Aug 26 18:16:29 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:16:27</nova:creationTime>
Aug 26 18:16:29 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:16:29 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:16:29 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:16:29 user nova-compute[73110]:       <nova:owner>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:user uuid="c70b048fb80b4bbe9d4e7cd5c0c58b46">tempest-TestShelveInstance-1970110709-project-member</nova:user>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:project uuid="9b02e837cbe0450aadbbc4e1e2edd2e8">tempest-TestShelveInstance-1970110709</nova:project>
Aug 26 18:16:29 user nova-compute[73110]:       </nova:owner>
Aug 26 18:16:29 user nova-compute[73110]:       <nova:ports>
Aug 26 18:16:29 user nova-compute[73110]:         <nova:port uuid="db7b3a2a-e250-4dd9-a150-6884a7790104">
Aug 26 18:16:29 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 18:16:29 user nova-compute[73110]:         </nova:port>
Aug 26 18:16:29 user nova-compute[73110]:       </nova:ports>
Aug 26 18:16:29 user nova-compute[73110]:     </nova:instance>
Aug 26 18:16:29 user nova-compute[73110]:   </metadata>
Aug 26 18:16:29 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:16:29 user nova-compute[73110]:     <system>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="serial">85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</entry>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="uuid">85b174a3-711e-4f66-a2ea-4d3d5a8c54d5</entry>
Aug 26 18:16:29 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:16:29 user nova-compute[73110]:     </system>
Aug 26 18:16:29 user nova-compute[73110]:   </sysinfo>
Aug 26 18:16:29 user nova-compute[73110]:   <os>
Aug 26 18:16:29 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:16:29 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:16:29 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:16:29 user nova-compute[73110]:   </os>
Aug 26 18:16:29 user nova-compute[73110]:   <features>
Aug 26 18:16:29 user nova-compute[73110]:     <acpi/>
Aug 26 18:16:29 user nova-compute[73110]:     <apic/>
Aug 26 18:16:29 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:16:29 user nova-compute[73110]:   </features>
Aug 26 18:16:29 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:16:29 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:16:29 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:16:29 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:16:29 user nova-compute[73110]:   </clock>
Aug 26 18:16:29 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:16:29 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:16:29 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:16:29 user nova-compute[73110]:   </cpu>
Aug 26 18:16:29 user nova-compute[73110]:   <devices>
Aug 26 18:16:29 user nova-compute[73110]:     <disk type="block" device="disk">
Aug 26 18:16:29 user nova-compute[73110]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:16:29 user nova-compute[73110]:       <source dev="/dev/sdc"/>
Aug 26 18:16:29 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:16:29 user nova-compute[73110]:       <serial>8fb12861-de40-4303-9671-6e1daa8d11eb</serial>
Aug 26 18:16:29 user nova-compute[73110]:     </disk>
Aug 26 18:16:29 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:16:29 user nova-compute[73110]:       <mac address="fa:16:3e:48:1d:c6"/>
Aug 26 18:16:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:16:29 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:16:29 user nova-compute[73110]:       <target dev="tapdb7b3a2a-e2"/>
Aug 26 18:16:29 user nova-compute[73110]:     </interface>
Aug 26 18:16:29 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:16:29 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5/console.log" append="off"/>
Aug 26 18:16:29 user nova-compute[73110]:     </serial>
Aug 26 18:16:29 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:16:29 user nova-compute[73110]:     <video>
Aug 26 18:16:29 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:16:29 user nova-compute[73110]:     </video>
Aug 26 18:16:29 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:16:29 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:16:29 user nova-compute[73110]:     </rng>
Aug 26 18:16:29 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:16:29 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:16:29 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:16:29 user nova-compute[73110]:     </memballoon>
Aug 26 18:16:29 user nova-compute[73110]:   </devices>
Aug 26 18:16:29 user nova-compute[73110]: </domain>
Aug 26 18:16:29 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-235173116',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:16:13Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG os_vif [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb7b3a2a-e2, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb7b3a2a-e2, col_values=(('external_ids', {'iface-id': 'db7b3a2a-e250-4dd9-a150-6884a7790104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:1d:c6', 'vm-uuid': '85b174a3-711e-4f66-a2ea-4d3d5a8c54d5'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:29 user nova-compute[73110]: INFO os_vif [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2')
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:16:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] No VIF found with MAC fa:16:3e:48:1d:c6, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:16:30 user nova-compute[73110]: WARNING nova.compute.manager [req-266e4b67-fed5-47e1-b3a3-b813bf24459b req-46673158-e425-4922-af92-5185c9c0d811 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 18:16:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073792.7146785, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:16:32 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Resumed (Lifecycle Event)
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:16:32 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance spawned successfully.
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:16:32 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073792.7184656, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:16:32 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Started (Lifecycle Event)
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-1779cd01-af94-4d00-a311-3b924242f906 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.432s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:16:32 user nova-compute[73110]: DEBUG nova.compute.manager [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:16:32 user nova-compute[73110]: WARNING nova.compute.manager [req-0c1d58b6-abb2-45ca-8e1d-9d53481e7795 req-2b942aea-b08b-491d-82ec-2e52c42b5ce1 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state active and task_state None.
Aug 26 18:16:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:33 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073778.6428368, b64db151-bb30-44d4-b9c9-51e88b0ecbe5 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:16:33 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] VM Stopped (Lifecycle Event)
Aug 26 18:16:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-f788b7ed-3478-415a-bbd0-e5e32ba3fb1d None None] [instance: b64db151-bb30-44d4-b9c9-51e88b0ecbe5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:16:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:36 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:16:37 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:16:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:16:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:16:48 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:16:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:16:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:06 user nova-compute[73110]: INFO nova.compute.manager [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Detaching volume f5d764b8-2e0b-4bca-9f27-ebfb52e619f0
Aug 26 18:17:06 user nova-compute[73110]: INFO nova.virt.block_device [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Attempting to driver detach volume f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 from mountpoint /dev/vdb
Aug 26 18:17:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Attempting to detach device vdb from instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:17:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:17:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:17:06 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:17:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:17:06 user nova-compute[73110]:   <serial>f5d764b8-2e0b-4bca-9f27-ebfb52e619f0</serial>
Aug 26 18:17:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:17:06 user nova-compute[73110]: </disk>
Aug 26 18:17:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:17:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully detached device vdb from instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 from the persistent domain config.
Aug 26 18:17:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:17:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:17:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:17:06 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:17:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:17:06 user nova-compute[73110]:   <serial>f5d764b8-2e0b-4bca-9f27-ebfb52e619f0</serial>
Aug 26 18:17:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:17:06 user nova-compute[73110]: </disk>
Aug 26 18:17:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:17:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693073827.3054085, dba01b7b-733f-404d-a9fb-6d0e67d12a36 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:17:07 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully detached device vdb from instance dba01b7b-733f-404d-a9fb-6d0e67d12a36 from the live domain config.
Aug 26 18:17:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpwCLFra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:17:07 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4c3a2-bdb7-471f-9128-dfc6d49a18f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f68da-33eb-4d70-b3e1-33a6c684a58b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:17:07 user nova-compute[73110]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:17:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 (non-flash)
Aug 26 18:17:07 user nova-compute[73110]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:17:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54420bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d92166-f4ea-4293-bac6-5b400b2a8e15]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff49e5b-bfb9-46ca-8474-ed139ff3990d]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c25dba-928d-4767-98e4-b5f0e6ae995f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc929496-ad95-48cb-8173-81e390956eaf]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ef9bf-ae73-4054-a8dc-1e9e5c7108a1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11094b-e571-452c-8815-c9b272e9d2d6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260]
Aug 26 18:17:07 user nova-compute[73110]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0, portal: 172.16.0.220,3260] successful.
Aug 26 18:17:07 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64fe1d-ddad-4cd6-9e8a-6d45e5de8b2d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== disconnect_volume: return (263ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:17:07 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG nova.objects.instance [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'flavor' on Instance uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-e7d10205-418e-4f8d-b9a0-5daab745ed36 tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.818s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.685s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:08 user nova-compute[73110]: INFO nova.compute.manager [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Terminating instance
Aug 26 18:17:08 user nova-compute[73110]: DEBUG nova.compute.manager [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-unplugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] No waiting events found dispatching network-vif-unplugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:17:08 user nova-compute[73110]: DEBUG nova.compute.manager [req-883c6f08-35d8-43de-92f5-39656b016829 req-c9834524-45ef-42d5-8264-3852b8f432b6 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-unplugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:17:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Instance destroyed successfully.
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lazy-loading 'resources' on Instance uuid dba01b7b-733f-404d-a9fb-6d0e67d12a36 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-375670116',display_name='tempest-VolumesSnapshotTestJSON-instance-375670116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-375670116',id=51,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Lui9nYp+AeeN3g4xzBXAqcNOL/UL2Uuob+7D1Skc9t17OpIRUcXCfpm9tbg61T4Za4gvhDoKKlDaZXQaWWHGeBAT6akwwz5qqitCSEZ1huJ8+lAV2DKHXvxnyFB5L3Q==',key_name='tempest-keypair-2000422798',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1797759abd6a48af86ab7feb4d1aed41',ramdisk_id='',reservation_id='r-0b31nzbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-872819359',owner_user_name='tempest-VolumesSnapshotTestJSON-872819359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8efb97268b45a1bb25476811227005',uuid=dba01b7b-733f-404d-a9fb-6d0e67d12a36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converting VIF {"id": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "address": "fa:16:3e:b5:42:20", "network": {"id": "b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-323796281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1797759abd6a48af86ab7feb4d1aed41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f8a950-6a", "ovs_interfaceid": "69f8a950-6aa0-4e40-aa87-44c41b6a8207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_vif [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f8a950-6a, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:17:09 user nova-compute[73110]: INFO os_vif [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:42:20,bridge_name='br-int',has_traffic_filtering=True,id=69f8a950-6aa0-4e40-aa87-44c41b6a8207,network=Network(b62e8fa0-2450-4f09-b1c8-6b19c92bd7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f8a950-6a')
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpwCLFra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:17:09 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5d764b8-2e0b-4bca-9f27-ebfb52e619f0', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad563424-a825-48f6-a9bf-7bc64696131c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f792c5-95b0-49cf-abbc-11cacc974634]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:17:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:17:09 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520d2bf40>, {}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Disconnecting from: [] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] <== disconnect_volume: return (49ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:17:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Deleting instance files /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36_del
Aug 26 18:17:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Deletion of /opt/stack/data/nova/instances/dba01b7b-733f-404d-a9fb-6d0e67d12a36_del complete
Aug 26 18:17:09 user nova-compute[73110]: INFO nova.compute.manager [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 18:17:09 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:17:09 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] Acquiring lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] No waiting events found dispatching network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:17:11 user nova-compute[73110]: WARNING nova.compute.manager [req-0deda6ec-7355-463b-acb8-9689004ab601 req-a86e6e43-6202-4f25-9157-040bcd926de3 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received unexpected event network-vif-plugged-69f8a950-6aa0-4e40-aa87-44c41b6a8207 for instance with vm_state active and task_state deleting.
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:17:11 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Took 1.58 seconds to deallocate network for instance.
Aug 26 18:17:11 user nova-compute[73110]: WARNING nova.volume.cinder [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Attachment 5bd5c652-a233-42bb-93c0-ab5df35cb46d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5bd5c652-a233-42bb-93c0-ab5df35cb46d. (HTTP 404) (Request-ID: req-e523f1a4-f33a-47a4-870c-97f825a19526)
Aug 26 18:17:11 user nova-compute[73110]: INFO nova.compute.manager [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.compute.manager [req-9797c021-ba28-4ab8-8ec6-7fd388aa71cb req-d9140b78-eff6-46fe-b670-5dc1b5b76ea2 service nova] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Received event network-vif-deleted-69f8a950-6aa0-4e40-aa87-44c41b6a8207 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:11 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Deleted allocations for instance dba01b7b-733f-404d-a9fb-6d0e67d12a36
Aug 26 18:17:11 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-34ff819b-b4b3-4296-9c41-aacf97d1e6ea tempest-VolumesSnapshotTestJSON-872819359 tempest-VolumesSnapshotTestJSON-872819359-project-member] Lock "dba01b7b-733f-404d-a9fb-6d0e67d12a36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:14 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:19 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:23 user nova-compute[73110]: INFO nova.compute.manager [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Terminating instance
Aug 26 18:17:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-1db9e42e-685d-4653-937f-312bdb6cc8ff req-a6e63844-5bdc-4cf8-8ff6-0aef6d971597 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-unplugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073829.3474028, dba01b7b-733f-404d-a9fb-6d0e67d12a36 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:17:24 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] VM Stopped (Lifecycle Event)
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-a258e821-6a2f-4dec-8ee2-b5d1e7de50a4 None None] [instance: dba01b7b-733f-404d-a9fb-6d0e67d12a36] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Instance destroyed successfully.
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'resources' on Instance uuid 63e267f9-e38d-4b07-b076-b4e76ccc5aff {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1669295859',display_name='tempest-TestMinimumBasicScenario-server-1669295859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1669295859',id=48,image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWiSu3YrImO6A/SyPNfPkz3kHYls0N09TY1uiQumD1eEda1GZP/9ITQderYTUKei0Cl0PfBzmGqB3fiovll8QT7AtIMxtzkx0gUfx4qHWhaCf1kZnzK4Q6kVXjzq2WyQ==',key_name='tempest-TestMinimumBasicScenario-83657621',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-el5eh5t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='842052f8-a7ab-4aba-a695-ee23d2043c41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:14:36Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=63e267f9-e38d-4b07-b076-b4e76ccc5aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "address": "fa:16:3e:12:f8:94", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap033c43b5-ad", "ovs_interfaceid": "033c43b5-ad80-45a8-a57a-e5bd6cf76b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG os_vif [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap033c43b5-ad, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:24 user nova-compute[73110]: INFO os_vif [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:f8:94,bridge_name='br-int',has_traffic_filtering=True,id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap033c43b5-ad')
Aug 26 18:17:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Deleting instance files /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff_del
Aug 26 18:17:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Deletion of /opt/stack/data/nova/instances/63e267f9-e38d-4b07-b076-b4e76ccc5aff_del complete
Aug 26 18:17:24 user nova-compute[73110]: INFO nova.compute.manager [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 18:17:24 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:17:24 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-1b773629-1bc6-468d-9464-2c18696ffa65 req-a28f00f1-9f0e-4952-95ba-ee250999e040 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-deleted-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:25 user nova-compute[73110]: INFO nova.compute.manager [req-1b773629-1bc6-468d-9464-2c18696ffa65 req-a28f00f1-9f0e-4952-95ba-ee250999e040 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Neutron deleted interface 033c43b5-ad80-45a8-a57a-e5bd6cf76b92; detaching it from the instance and deleting it from the info cache
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.network.neutron [req-1b773629-1bc6-468d-9464-2c18696ffa65 req-a28f00f1-9f0e-4952-95ba-ee250999e040 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:17:25 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Took 0.65 seconds to deallocate network for instance.
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-1b773629-1bc6-468d-9464-2c18696ffa65 req-a28f00f1-9f0e-4952-95ba-ee250999e040 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Detach interface failed, port_id=033c43b5-ad80-45a8-a57a-e5bd6cf76b92, reason: Instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff could not be found. {{(pid=73110) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:17:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:25 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Deleted allocations for instance 63e267f9-e38d-4b07-b076-b4e76ccc5aff
Aug 26 18:17:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-348f5a71-7d40-44c2-b60c-adfaa408c3ab tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:17:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] Acquiring lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] Lock "63e267f9-e38d-4b07-b076-b4e76ccc5aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:26 user nova-compute[73110]: DEBUG nova.compute.manager [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] No waiting events found dispatching network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:17:26 user nova-compute[73110]: WARNING nova.compute.manager [req-21b180ce-e470-49d2-a754-1f5fc9416679 req-627554be-113b-437a-9708-ce003e54e898 service nova] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Received unexpected event network-vif-plugged-033c43b5-ad80-45a8-a57a-e5bd6cf76b92 for instance with vm_state deleted and task_state None.
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:17:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:17:28 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=25.11859130859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:17:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:17:29 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:34 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073844.5890644, 63e267f9-e38d-4b07-b076-b4e76ccc5aff => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:17:39 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] VM Stopped (Lifecycle Event)
Aug 26 18:17:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-6fd12b2f-67f9-4fb3-872c-63bd0c258c4c None None] [instance: 63e267f9-e38d-4b07-b076-b4e76ccc5aff] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:39 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:17:44 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:17:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:17:59 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing instance network info cache due to event network-changed-db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] Acquiring lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] Acquired lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Refreshing network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:04 user nova-compute[73110]: INFO nova.compute.manager [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Terminating instance
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updated VIF entry in instance network info cache for port db7b3a2a-e250-4dd9-a150-6884a7790104. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.network.neutron [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [{"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-4c5c4eca-dd9b-43be-a450-f514255bc3ab req-a0d81f37-e35b-4a76-8d33-415ba04c2d62 service nova] Releasing lock "refresh_cache-85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:18:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-b1949e03-6a0a-4982-ad1c-b8ad221b0835 req-b5b7c640-7848-426f-9e67-0acf67cccd78 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-unplugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:05 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Instance destroyed successfully.
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.objects.instance [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lazy-loading 'resources' on Instance uuid 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T18:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-889878797',display_name='tempest-TestShelveInstance-server-889878797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-889878797',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX1mVxuUTl23T8T0z27JxGhgKJiOnXE7xOwWSl5Tj6mr6fOnAZ+PVa05xUNPRuzC98FCxY4GKuQR4UDvLDNhzjBcAWWDIZthsP50nVaGl8LjPulWv/AClLmYE223GTOiA==',key_name='tempest-TestShelveInstance-235173116',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:16:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b02e837cbe0450aadbbc4e1e2edd2e8',ramdisk_id='',reservation_id='r-uauqzm6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1970110709',owner_user_name='tempest-TestShelveInstance-1970110709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:16:33Z,user_data=None,user_id='c70b048fb80b4bbe9d4e7cd5c0c58b46',uuid=85b174a3-711e-4f66-a2ea-4d3d5a8c54d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converting VIF {"id": "db7b3a2a-e250-4dd9-a150-6884a7790104", "address": "fa:16:3e:48:1d:c6", "network": {"id": "af5faa20-5926-48af-8822-a5a76c646dff", "bridge": "br-int", "label": "tempest-TestShelveInstance-522040589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b02e837cbe0450aadbbc4e1e2edd2e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7b3a2a-e2", "ovs_interfaceid": "db7b3a2a-e250-4dd9-a150-6884a7790104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_vif [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb7b3a2a-e2, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:18:05 user nova-compute[73110]: INFO os_vif [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:1d:c6,bridge_name='br-int',has_traffic_filtering=True,id=db7b3a2a-e250-4dd9-a150-6884a7790104,network=Network(af5faa20-5926-48af-8822-a5a76c646dff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7b3a2a-e2')
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMuavVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:18:05 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c60b669-1ba5-44e7-90d3-eae23a734cfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f68b4-b011-4f78-ab3f-9d8bb87de6bf]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:18:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb (non-flash)
Aug 26 18:18:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54461d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb'): ({'sdc'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Removing single pathed devices sdc {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef93d043-f7da-455b-baab-f49c6e1e6598]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[365105af-d0c8-470a-a2ca-5ea4b5e7cb19]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Flushing IO for device /dev/sdc {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8587dc1-70db-4da5-a5b4-07a26850158d]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aff9bc-5d71-4e40-ad95-194d3fad89c8]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] SCSI volumes sdc have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd78ba640-58bfa62912bc03e5', '/dev/disk/by-id/scsi-23538626661363239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d78ba640') {{(pid=84436) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c558a-e98a-40d7-b654-1bdd4280163d]: (4, None) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b107446-bf0c-44de-b9ac-8ace6443d22f]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc6dc59-61bd-408f-839b-a5e492de2cf2]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260]
Aug 26 18:18:05 user nova-compute[73110]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb, portal: 172.16.0.220,3260] successful.
Aug 26 18:18:05 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fb12861-de40-4303-9671-6e1daa8d11eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb08e07-60f1-44b6-a19b-073f3945f5b5]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] <== disconnect_volume: return (285ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:18:05 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deleting instance files /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5_del
Aug 26 18:18:05 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deletion of /opt/stack/data/nova/instances/85b174a3-711e-4f66-a2ea-4d3d5a8c54d5_del complete
Aug 26 18:18:05 user nova-compute[73110]: INFO nova.compute.manager [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 18:18:05 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:18:05 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:18:06 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Took 0.60 seconds to deallocate network for instance.
Aug 26 18:18:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-8daa9613-890e-420c-9499-ce35edf80e41 req-4aad7cb3-0a18-4a84-af35-3f970a957dd7 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-deleted-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] Acquiring lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:06 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] No waiting events found dispatching network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:18:06 user nova-compute[73110]: WARNING nova.compute.manager [req-c3cceb90-a67a-4277-a267-127260cfd137 req-aee8338c-0a87-425a-81d2-5c9b55ed0b88 service nova] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Received unexpected event network-vif-plugged-db7b3a2a-e250-4dd9-a150-6884a7790104 for instance with vm_state active and task_state deleting.
Aug 26 18:18:07 user nova-compute[73110]: INFO nova.compute.manager [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Took 1.19 seconds to detach 1 volumes for instance.
Aug 26 18:18:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Deleting volume: 8fb12861-de40-4303-9671-6e1daa8d11eb {{(pid=73110) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 18:18:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:07 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:18:07 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:18:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:07 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Deleted allocations for instance 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5
Aug 26 18:18:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-5113ce74-8e45-4976-bd28-be9a2e7cd0a3 tempest-TestShelveInstance-1970110709 tempest-TestShelveInstance-1970110709-project-member] Lock "85b174a3-711e-4f66-a2ea-4d3d5a8c54d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.348s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:18:18 user nova-compute[73110]: INFO nova.compute.claims [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Claim successful on node user
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:18:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.policy [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2359790ef72c447681b40e1548d1d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9330d1982ea343b691f895aeddde36db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:18:18 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Creating image(s)
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "/opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "/opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "/opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:18 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.part --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Successfully created port: 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.part --force-share --output=json" returned: 0 in 0.206s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG nova.virt.images [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] 5c7b2a41-d012-4828-9f4d-4bf6367cd466 was qcow2, converting to raw {{(pid=73110) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG nova.privsep.utils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73110) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 18:18:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.part /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.converted {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693073885.0657778, 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:18:20 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] VM Stopped (Lifecycle Event)
Aug 26 18:18:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.compute.manager [None req-0ac4e845-7106-4433-b1ec-908a57117434 None None] [instance: 85b174a3-711e-4f66-a2ea-4d3d5a8c54d5] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.part /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.converted" returned: 0 in 0.764s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.converted --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.772s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Successfully updated port: 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json" returned: 0 in 0.183s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.compute.manager [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing instance network info cache due to event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:20 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f,backing_fmt=raw /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f,backing_fmt=raw /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk 1073741824" returned: 0 in 0.056s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "b2aba327e29ad5a9bd5325b89af08b4fccdeee1f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2aba327e29ad5a9bd5325b89af08b4fccdeee1f --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.neutron [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance network_info: |[{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Cannot resize image /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Ensure instance console log exists: /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Start _get_guest_xml network_info=[{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T18:18:15Z,direct_url=<?>,disk_format='qcow2',id=5c7b2a41-d012-4828-9f4d-4bf6367cd466,min_disk=0,min_ram=0,name='tempest-scenario-img--708579906',owner='9330d1982ea343b691f895aeddde36db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T18:18:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '5c7b2a41-d012-4828-9f4d-4bf6367cd466'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:18:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:18:21 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T18:18:15Z,direct_url=<?>,disk_format='qcow2',id=5c7b2a41-d012-4828-9f4d-4bf6367cd466,min_disk=0,min_ram=0,name='tempest-scenario-img--708579906',owner='9330d1982ea343b691f895aeddde36db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T18:18:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1134896756',display_name='tempest-TestMinimumBasicScenario-server-1134896756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1134896756',id=52,image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X0s/vo95ztGUJLE74zV2SqR7ahjOoFYhgaCvZ7XLL8oU2IwvuVcdzg8y1H6waBZBZM8DbNpQ88hcNBBoYtUqDAKkE9/mhdyyzeAfAyQraZwXXb+ZaHwVVEAGCn/2Yrw==',key_name='tempest-TestMinimumBasicScenario-1855283262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-by0xv2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:18:19Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=00d5b19d-5a86-497a-b8a9-5f337667e1e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.objects.instance [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:18:21 user nova-compute[73110]:   <uuid>00d5b19d-5a86-497a-b8a9-5f337667e1e3</uuid>
Aug 26 18:18:21 user nova-compute[73110]:   <name>instance-00000034</name>
Aug 26 18:18:21 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:18:21 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:18:21 user nova-compute[73110]:   <metadata>
Aug 26 18:18:21 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:18:21 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:name>tempest-TestMinimumBasicScenario-server-1134896756</nova:name>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:18:21</nova:creationTime>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:18:21 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:18:21 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:owner>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:user uuid="2359790ef72c447681b40e1548d1d2f2">tempest-TestMinimumBasicScenario-51070138-project-member</nova:user>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:project uuid="9330d1982ea343b691f895aeddde36db">tempest-TestMinimumBasicScenario-51070138</nova:project>
Aug 26 18:18:21 user nova-compute[73110]:       </nova:owner>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:root type="image" uuid="5c7b2a41-d012-4828-9f4d-4bf6367cd466"/>
Aug 26 18:18:21 user nova-compute[73110]:       <nova:ports>
Aug 26 18:18:21 user nova-compute[73110]:         <nova:port uuid="1a3212c8-85b3-4740-bac7-796d90bed2ff">
Aug 26 18:18:21 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 18:18:21 user nova-compute[73110]:         </nova:port>
Aug 26 18:18:21 user nova-compute[73110]:       </nova:ports>
Aug 26 18:18:21 user nova-compute[73110]:     </nova:instance>
Aug 26 18:18:21 user nova-compute[73110]:   </metadata>
Aug 26 18:18:21 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:18:21 user nova-compute[73110]:     <system>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="serial">00d5b19d-5a86-497a-b8a9-5f337667e1e3</entry>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="uuid">00d5b19d-5a86-497a-b8a9-5f337667e1e3</entry>
Aug 26 18:18:21 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:18:21 user nova-compute[73110]:     </system>
Aug 26 18:18:21 user nova-compute[73110]:   </sysinfo>
Aug 26 18:18:21 user nova-compute[73110]:   <os>
Aug 26 18:18:21 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:18:21 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:18:21 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:18:21 user nova-compute[73110]:   </os>
Aug 26 18:18:21 user nova-compute[73110]:   <features>
Aug 26 18:18:21 user nova-compute[73110]:     <acpi/>
Aug 26 18:18:21 user nova-compute[73110]:     <apic/>
Aug 26 18:18:21 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:18:21 user nova-compute[73110]:   </features>
Aug 26 18:18:21 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:18:21 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:18:21 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:18:21 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:18:21 user nova-compute[73110]:   </clock>
Aug 26 18:18:21 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:18:21 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:18:21 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:18:21 user nova-compute[73110]:   </cpu>
Aug 26 18:18:21 user nova-compute[73110]:   <devices>
Aug 26 18:18:21 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:18:21 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:18:21 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk"/>
Aug 26 18:18:21 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:18:21 user nova-compute[73110]:     </disk>
Aug 26 18:18:21 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:18:21 user nova-compute[73110]:       <mac address="fa:16:3e:ea:b6:79"/>
Aug 26 18:18:21 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:18:21 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:18:21 user nova-compute[73110]:       <target dev="tap1a3212c8-85"/>
Aug 26 18:18:21 user nova-compute[73110]:     </interface>
Aug 26 18:18:21 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:18:21 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/console.log" append="off"/>
Aug 26 18:18:21 user nova-compute[73110]:     </serial>
Aug 26 18:18:21 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:18:21 user nova-compute[73110]:     <video>
Aug 26 18:18:21 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:18:21 user nova-compute[73110]:     </video>
Aug 26 18:18:21 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:18:21 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:18:21 user nova-compute[73110]:     </rng>
Aug 26 18:18:21 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:18:21 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:18:21 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:18:21 user nova-compute[73110]:     </memballoon>
Aug 26 18:18:21 user nova-compute[73110]:   </devices>
Aug 26 18:18:21 user nova-compute[73110]: </domain>
Aug 26 18:18:21 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1134896756',display_name='tempest-TestMinimumBasicScenario-server-1134896756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1134896756',id=52,image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X0s/vo95ztGUJLE74zV2SqR7ahjOoFYhgaCvZ7XLL8oU2IwvuVcdzg8y1H6waBZBZM8DbNpQ88hcNBBoYtUqDAKkE9/mhdyyzeAfAyQraZwXXb+ZaHwVVEAGCn/2Yrw==',key_name='tempest-TestMinimumBasicScenario-1855283262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-by0xv2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:18:19Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=00d5b19d-5a86-497a-b8a9-5f337667e1e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG os_vif [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a3212c8-85, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a3212c8-85, col_values=(('external_ids', {'iface-id': '1a3212c8-85b3-4740-bac7-796d90bed2ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:b6:79', 'vm-uuid': '00d5b19d-5a86-497a-b8a9-5f337667e1e3'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:21 user nova-compute[73110]: INFO os_vif [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85')
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No VIF found with MAC fa:16:3e:ea:b6:79, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated VIF entry in instance network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG nova.network.neutron [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:18:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-ff326b77-2e7f-4deb-84d6-2cd242f12d13 req-68d963ed-7348-412c-87fa-44f51d8a30bc service nova] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:18:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:22 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:18:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:18:23 user nova-compute[73110]: WARNING nova.compute.manager [req-c9fc8c7f-c8f0-457d-8931-e6801ced2a7c req-08eafd09-ceb9-4c61-96e5-5af0e569c73c service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state building and task_state spawning.
Aug 26 18:18:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Skipping network cache update for instance because it is Building. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073905.039688, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] VM Resumed (Lifecycle Event)
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance spawned successfully.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693073905.0676, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] VM Started (Lifecycle Event)
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:18:25 user nova-compute[73110]: WARNING nova.compute.manager [req-32e20527-ee5f-458e-8e09-da267189dbaf req-e6101b9c-8ba9-4e3d-bb08-e8ca688e85a5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state building and task_state spawning.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:18:25 user nova-compute[73110]: INFO nova.compute.manager [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Took 7.09 seconds to build instance.
Aug 26 18:18:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-33de3838-1e24-4507-847a-64a7820fc0c2 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.195s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:18:28 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:18:29 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:18:29 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.087261199951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:18:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:18:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:18:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:41 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:18:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:18:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:19:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:22 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:23 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:19:23 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:19:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:19:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:19:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:19:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:19:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:19:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:19:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:19:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.05740737915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:19:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:19:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:19:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:44 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:19:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:19:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:20:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:20:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:12 user nova-compute[73110]: INFO nova.compute.manager [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Attaching volume c05c1086-af18-4c2a-be21-5f74e9a47537 to /dev/vdb
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.utils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d39b4-8ce4-4419-9c70-3dcbfaf57868]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5326d-491a-4960-ba3b-ed27919405ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ce947-3d02-463b-ad46-d7df4bbec8d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527c20a-456c-4fb7-bc4f-3a4852a3f838]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:20:12 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:20:12 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf37864-c06f-4128-b290-358a172a41c4]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG os_brick.utils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:20:12 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating existing volume attachment record: a5f95534-7c8e-4e93-97e7-d756f8be23fc {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:20:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:20:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUrygqis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:20:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:20:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:20:23 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5864939f-8a1f-4fe6-8749-e30f95eb1643]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:20:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b241d1-2a25-4fb3-8ec8-b3afe4122f1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537] added
Aug 26 18:20:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc6c24-3479-4843-a7ae-b601daba8d23]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd902c88-f32f-465e-9063-e01b7300a5a4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SUrygqis {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SUrygqis" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c97c32-e398-424c-b04a-2b4bb397ee8e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SUrygqis'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7fd03a-6998-4831-9bf5-8c0193b37703]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1dfae-c0c5-42b6-a0c5-89ff6fd10abb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:20:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:20:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:20:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:20:23 user nova-compute[73110]: 
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a0edc1-b0de-4cb0-9e2c-010938b3ddc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260]
Aug 26 18:20:23 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260] successful.
Aug 26 18:20:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b0e7f8-829f-41d1-b985-e00bb0d3208b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d68f85a-df50-41bc-bdf9-19e398f47656]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)
Aug 26 18:20:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)
Aug 26 18:20:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf7e4a-f841-43b9-9852-937eb2dd3721]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:20:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUrygqis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23066623964373637', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623964373637', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:20:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:20:24 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:20:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:20:24 user nova-compute[73110]:   <serial>c05c1086-af18-4c2a-be21-5f74e9a47537</serial>
Aug 26 18:20:24 user nova-compute[73110]: </disk>
Aug 26 18:20:24 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:20:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] No VIF found with MAC fa:16:3e:ea:b6:79, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-0cac698a-b2eb-47a6-924f-a027d0163cb3 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.561s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:25 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:20:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:20:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG nova.compute.manager [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing instance network info cache due to event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:20:27 user nova-compute[73110]: DEBUG nova.network.neutron [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:20:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated VIF entry in instance network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:20:28 user nova-compute[73110]: DEBUG nova.network.neutron [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:20:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c41bce3a-7b7d-4ac8-9fc1-288d699db1d8 req-68fb3f8b-4438-4a16-87e5-16a707fca3c5 service nova] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:20:29 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.manager [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing instance network info cache due to event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:20:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:20:30 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.05630874633789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:30 user nova-compute[73110]: INFO nova.compute.manager [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Rebooting instance
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated VIF entry in instance network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.network.neutron [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a7c79b95-da3a-448f-ab4a-200b31575d93 req-c61a95dc-c1a5-4b66-9f55-0da385972805 service nova] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:20:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:20:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:20:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:20:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:20:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:33 user nova-compute[73110]: DEBUG nova.compute.manager [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:20:33 user nova-compute[73110]: WARNING nova.compute.manager [req-c9095e5f-49a9-4e3e-bcf3-bb04819cf0ce req-f3c9456e-c438-4b82-9fca-0e49340115f0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state active and task_state reboot_started.
Aug 26 18:20:34 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance shutdown successfully.
Aug 26 18:20:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:20:35 user nova-compute[73110]: WARNING nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state active and task_state reboot_started.
Aug 26 18:20:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:35 user nova-compute[73110]: DEBUG nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:20:35 user nova-compute[73110]: WARNING nova.compute.manager [req-1762d1f4-702d-4bee-9eea-7359ef480eb1 req-c209e31a-2ca4-4352-835b-d4e3fe05cd56 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state active and task_state reboot_started.
Aug 26 18:20:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Removed pending event for 00d5b19d-5a86-497a-b8a9-5f337667e1e3 due to event {{(pid=73110) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693074037.5881686, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:20:37 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] VM Resumed (Lifecycle Event)
Aug 26 18:20:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance running successfully.
Aug 26 18:20:37 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance soft rebooted successfully.
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:20:37 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693074037.5893822, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:20:37 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] VM Started (Lifecycle Event)
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-77f70798-6e78-4af1-a5fd-e270c1d25628 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.537s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:20:37 user nova-compute[73110]: DEBUG nova.compute.manager [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:20:37 user nova-compute[73110]: WARNING nova.compute.manager [req-b09fb572-f73a-4471-8106-1177325969ec req-d526012a-5679-487f-a9b6-224265c5bdb3 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state active and task_state None.
Aug 26 18:20:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:20:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:20:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:21:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:26 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:21:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:21:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:21:30 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:21:31 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:21:31 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.05474090576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:21:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:21:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:39 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:39 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:21:41 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:21:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:21:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:21:55 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:21:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:21:55 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:21:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:22:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:22:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG nova.compute.manager [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing instance network info cache due to event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:22:22 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:22:23 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated VIF entry in instance network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5c8a87dd-45e9-46a0-ae56-6727fcdd17ba req-902b56cc-011a-4ab6-b2f2-3fd6ebe8cd2f service nova] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.compute.manager [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing instance network info cache due to event network-changed-1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Refreshing network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:22:24 user nova-compute[73110]: INFO nova.compute.manager [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Detaching volume c05c1086-af18-4c2a-be21-5f74e9a47537
Aug 26 18:22:24 user nova-compute[73110]: INFO nova.virt.block_device [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Attempting to driver detach volume c05c1086-af18-4c2a-be21-5f74e9a47537 from mountpoint /dev/vdb
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Attempting to detach device vdb from instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:22:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:22:24 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:22:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:22:24 user nova-compute[73110]:   <serial>c05c1086-af18-4c2a-be21-5f74e9a47537</serial>
Aug 26 18:22:24 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:22:24 user nova-compute[73110]: </disk>
Aug 26 18:22:24 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:22:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully detached device vdb from instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 from the persistent domain config.
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:22:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:22:24 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:22:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:22:24 user nova-compute[73110]:   <serial>c05c1086-af18-4c2a-be21-5f74e9a47537</serial>
Aug 26 18:22:24 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:22:24 user nova-compute[73110]: </disk>
Aug 26 18:22:24 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated VIF entry in instance network info cache for port 1a3212c8-85b3-4740-bac7-796d90bed2ff. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.network.neutron [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-c3194b72-9739-4569-99ef-5c9a2610d46b req-1de21b41-7f1c-4f78-947e-0d9e61396f54 service nova] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:22:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693074144.9986992, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:22:25 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully detached device vdb from instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 from the live domain config.
Aug 26 18:22:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SUrygqis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:22:25 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c674a-9981-4f83-bce9-2104cb856bb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0c9420-81d3-40d0-89a3-7c012fdd8f2b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)
Aug 26 18:22:25 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 (non-flash)
Aug 26 18:22:25 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd564320940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e35aa3-3f5d-4df1-af5e-c4dbc7474d3e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[15683769-52f0-4283-bbcb-da6f19d98840]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4491fa63-ca0d-4fd5-a066-371c2243192a]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f625261-f17b-4b42-bfdc-1bc41687bbd8]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d523002-ab57-4e8a-9c4e-d9a2fc618ec4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ff6e0-ea7b-4660-823f-6efb4c26948a]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260]
Aug 26 18:22:25 user nova-compute[73110]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537, portal: 172.16.0.220,3260] successful.
Aug 26 18:22:25 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c05c1086-af18-4c2a-be21-5f74e9a47537 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34e534-6198-4b94-b776-3ebe76188de1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] <== disconnect_volume: return (255ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:22:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:26 user nova-compute[73110]: DEBUG nova.objects.instance [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'flavor' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:22:26 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-f5d85bfd-2d43-4183-aecd-9208a9ae1f65 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:22:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [{"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-00d5b19d-5a86-497a-b8a9-5f337667e1e3" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:22:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:22:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:22:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:22:31 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:22:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:22:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.053958892822266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:22:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:22:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:22:41 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:45 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:22:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:22:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:21 user nova-compute[73110]: INFO nova.compute.manager [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Terminating instance
Aug 26 18:23:21 user nova-compute[73110]: DEBUG nova.compute.manager [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:23:21 user nova-compute[73110]: DEBUG nova.compute.manager [req-a23e790c-0566-4dec-9f6f-8db371c302de req-6b8776f4-c9cc-4daf-8d2a-9f1ecbd3dcb0 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-unplugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:23:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Instance destroyed successfully.
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.objects.instance [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lazy-loading 'resources' on Instance uuid 00d5b19d-5a86-497a-b8a9-5f337667e1e3 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1134896756',display_name='tempest-TestMinimumBasicScenario-server-1134896756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1134896756',id=52,image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X0s/vo95ztGUJLE74zV2SqR7ahjOoFYhgaCvZ7XLL8oU2IwvuVcdzg8y1H6waBZBZM8DbNpQ88hcNBBoYtUqDAKkE9/mhdyyzeAfAyQraZwXXb+ZaHwVVEAGCn/2Yrw==',key_name='tempest-TestMinimumBasicScenario-1855283262',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9330d1982ea343b691f895aeddde36db',ramdisk_id='',reservation_id='r-by0xv2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c7b2a41-d012-4828-9f4d-4bf6367cd466',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51070138',owner_user_name='tempest-TestMinimumBasicScenario-51070138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:20:38Z,user_data=None,user_id='2359790ef72c447681b40e1548d1d2f2',uuid=00d5b19d-5a86-497a-b8a9-5f337667e1e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converting VIF {"id": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "address": "fa:16:3e:ea:b6:79", "network": {"id": "56cb7989-2af8-4eea-ac5a-f05ffff97415", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1978103293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9330d1982ea343b691f895aeddde36db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3212c8-85", "ovs_interfaceid": "1a3212c8-85b3-4740-bac7-796d90bed2ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG os_vif [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a3212c8-85, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:22 user nova-compute[73110]: INFO os_vif [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:b6:79,bridge_name='br-int',has_traffic_filtering=True,id=1a3212c8-85b3-4740-bac7-796d90bed2ff,network=Network(56cb7989-2af8-4eea-ac5a-f05ffff97415),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3212c8-85')
Aug 26 18:23:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Deleting instance files /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3_del
Aug 26 18:23:22 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Deletion of /opt/stack/data/nova/instances/00d5b19d-5a86-497a-b8a9-5f337667e1e3_del complete
Aug 26 18:23:22 user nova-compute[73110]: INFO nova.compute.manager [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 18:23:22 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:23:22 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Took 0.53 seconds to deallocate network for instance.
Aug 26 18:23:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:23:22 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:23 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Deleted allocations for instance 00d5b19d-5a86-497a-b8a9-5f337667e1e3
Aug 26 18:23:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-27094f56-5ce9-4e23-a4f8-5b496252ab73 tempest-TestMinimumBasicScenario-51070138 tempest-TestMinimumBasicScenario-51070138-project-member] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] Acquiring lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] Lock "00d5b19d-5a86-497a-b8a9-5f337667e1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] No waiting events found dispatching network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:23:23 user nova-compute[73110]: WARNING nova.compute.manager [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received unexpected event network-vif-plugged-1a3212c8-85b3-4740-bac7-796d90bed2ff for instance with vm_state deleted and task_state None.
Aug 26 18:23:23 user nova-compute[73110]: DEBUG nova.compute.manager [req-5545c409-217b-4f25-97f4-8492632bb9e9 req-e01d831d-8132-4b24-9ac1-9a5dd871f544 service nova] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Received event network-vif-deleted-1a3212c8-85b3-4740-bac7-796d90bed2ff {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:23:24 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:23:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:23:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:23:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:23:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.081317901611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:23:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693074202.109429, 00d5b19d-5a86-497a-b8a9-5f337667e1e3 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:23:37 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] VM Stopped (Lifecycle Event)
Aug 26 18:23:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-d8492c25-0c00-4c16-aae9-ffaf2e553e6a None None] [instance: 00d5b19d-5a86-497a-b8a9-5f337667e1e3] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:23:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:23:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:23:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:24:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:24:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:12 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:17 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:18 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:22 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:26 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:24:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:24:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:24:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:24:32 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.114826202392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:24:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.099s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:24:37 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:41 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:42 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:47 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:24:49 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:52 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:24:57 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:01 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Starting instance... {{(pid=73110) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73110) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 18:25:02 user nova-compute[73110]: INFO nova.compute.claims [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Claim successful on node user
Aug 26 18:25:02 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Start building networks asynchronously for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Allocating IP information in the background. {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] allocate_for_instance() {{(pid=73110) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 18:25:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Start building block device mappings for instance. {{(pid=73110) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.policy [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92f02624dd4641538d232b395307319d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd65ae37034b468096d79d67af12e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73110) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Start spawning the instance on the hypervisor. {{(pid=73110) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Creating instance directory {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 18:25:02 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Creating image(s)
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "/opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "/opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "/opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.282s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.211s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk 1073741824 {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd,backing_fmt=raw /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk 1073741824" returned: 0 in 0.065s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "f608f0f717d580f5a680fa6ac49f2ea8b85725bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f608f0f717d580f5a680fa6ac49f2ea8b85725bd --force-share --output=json" returned: 0 in 0.253s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk. size=1073741824 {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG nova.virt.disk.api [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Cannot resize image /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk to a smaller size. {{(pid=73110) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Created local disks {{(pid=73110) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Ensure instance console log exists: /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/console.log {{(pid=73110) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:03 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Successfully created port: 195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Successfully updated port: 195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Building network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-changed-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG nova.compute.manager [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Refreshing instance network info cache due to event network-changed-195189c5-d35f-4500-8e25-e9cf87b978d9. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:25:04 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Instance cache missing network info. {{(pid=73110) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.neutron [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Instance network_info: |[{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73110) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.neutron [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Refreshing network info cache for port 195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Start _get_guest_xml network_info=[{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'device_type': 'disk', 'image_id': '4299a158-616a-46c3-b665-9d8a5d47a509'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 18:25:05 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:25:05 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CPU controller missing on host. {{(pid=73110) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.host [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CPU controller found on host. {{(pid=73110) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73110) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T17:36:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T17:36:14Z,direct_url=<?>,disk_format='qcow2',id=4299a158-616a-46c3-b665-9d8a5d47a509,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='54b871ad8fc342588aec66c9783106f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T17:36:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flavor limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Image limits 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flavor pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Image pref 0:0:0 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Got 1 possible topologies {{(pid=73110) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.hardware [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73110) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-875237925',display_name='tempest-SnapshotDataIntegrityTests-server-875237925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-875237925',id=53,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcoqZJinJWdJzl1r9yHN6qCtB+4uQBwcclJ+6viSN+6XtSc5vkv9heDZy/A1c+/BZeGkQVTnOiHSsMUFeybGjTtjYMhyll24nh0+6ZOIEn7LDqKWr26kLsQ77u3UYa5pA==',key_name='tempest-keypair-858670905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcd65ae37034b468096d79d67af12e3',ramdisk_id='',reservation_id='r-sns4lnux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2067362385',owner_user_name='tempest-SnapshotDataIntegrityTests-2067362385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f02624dd4641538d232b395307319d',uuid=24dff064-8f29-4056-904d-1c4d07477561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73110) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converting VIF {"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.objects.instance [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'pci_devices' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] End _get_guest_xml xml=<domain type="kvm">
Aug 26 18:25:05 user nova-compute[73110]:   <uuid>24dff064-8f29-4056-904d-1c4d07477561</uuid>
Aug 26 18:25:05 user nova-compute[73110]:   <name>instance-00000035</name>
Aug 26 18:25:05 user nova-compute[73110]:   <memory>524288</memory>
Aug 26 18:25:05 user nova-compute[73110]:   <vcpu>1</vcpu>
Aug 26 18:25:05 user nova-compute[73110]:   <metadata>
Aug 26 18:25:05 user nova-compute[73110]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 18:25:05 user nova-compute[73110]:       <nova:package version="0.0.0"/>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-875237925</nova:name>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:creationTime>2023-08-26 18:25:05</nova:creationTime>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:flavor name="m1.tiny">
Aug 26 18:25:05 user nova-compute[73110]:         <nova:memory>512</nova:memory>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:disk>1</nova:disk>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:swap>0</nova:swap>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:vcpus>1</nova:vcpus>
Aug 26 18:25:05 user nova-compute[73110]:       </nova:flavor>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:owner>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:user uuid="92f02624dd4641538d232b395307319d">tempest-SnapshotDataIntegrityTests-2067362385-project-member</nova:user>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:project uuid="edcd65ae37034b468096d79d67af12e3">tempest-SnapshotDataIntegrityTests-2067362385</nova:project>
Aug 26 18:25:05 user nova-compute[73110]:       </nova:owner>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:root type="image" uuid="4299a158-616a-46c3-b665-9d8a5d47a509"/>
Aug 26 18:25:05 user nova-compute[73110]:       <nova:ports>
Aug 26 18:25:05 user nova-compute[73110]:         <nova:port uuid="195189c5-d35f-4500-8e25-e9cf87b978d9">
Aug 26 18:25:05 user nova-compute[73110]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 18:25:05 user nova-compute[73110]:         </nova:port>
Aug 26 18:25:05 user nova-compute[73110]:       </nova:ports>
Aug 26 18:25:05 user nova-compute[73110]:     </nova:instance>
Aug 26 18:25:05 user nova-compute[73110]:   </metadata>
Aug 26 18:25:05 user nova-compute[73110]:   <sysinfo type="smbios">
Aug 26 18:25:05 user nova-compute[73110]:     <system>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="product">OpenStack Nova</entry>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="version">0.0.0</entry>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="serial">24dff064-8f29-4056-904d-1c4d07477561</entry>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="uuid">24dff064-8f29-4056-904d-1c4d07477561</entry>
Aug 26 18:25:05 user nova-compute[73110]:       <entry name="family">Virtual Machine</entry>
Aug 26 18:25:05 user nova-compute[73110]:     </system>
Aug 26 18:25:05 user nova-compute[73110]:   </sysinfo>
Aug 26 18:25:05 user nova-compute[73110]:   <os>
Aug 26 18:25:05 user nova-compute[73110]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 18:25:05 user nova-compute[73110]:     <boot dev="hd"/>
Aug 26 18:25:05 user nova-compute[73110]:     <smbios mode="sysinfo"/>
Aug 26 18:25:05 user nova-compute[73110]:   </os>
Aug 26 18:25:05 user nova-compute[73110]:   <features>
Aug 26 18:25:05 user nova-compute[73110]:     <acpi/>
Aug 26 18:25:05 user nova-compute[73110]:     <apic/>
Aug 26 18:25:05 user nova-compute[73110]:     <vmcoreinfo/>
Aug 26 18:25:05 user nova-compute[73110]:   </features>
Aug 26 18:25:05 user nova-compute[73110]:   <clock offset="utc">
Aug 26 18:25:05 user nova-compute[73110]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 18:25:05 user nova-compute[73110]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 18:25:05 user nova-compute[73110]:     <timer name="hpet" present="no"/>
Aug 26 18:25:05 user nova-compute[73110]:   </clock>
Aug 26 18:25:05 user nova-compute[73110]:   <cpu mode="custom" match="exact">
Aug 26 18:25:05 user nova-compute[73110]:     <model>Nehalem</model>
Aug 26 18:25:05 user nova-compute[73110]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 18:25:05 user nova-compute[73110]:   </cpu>
Aug 26 18:25:05 user nova-compute[73110]:   <devices>
Aug 26 18:25:05 user nova-compute[73110]:     <disk type="file" device="disk">
Aug 26 18:25:05 user nova-compute[73110]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 18:25:05 user nova-compute[73110]:       <source file="/opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk"/>
Aug 26 18:25:05 user nova-compute[73110]:       <target dev="vda" bus="virtio"/>
Aug 26 18:25:05 user nova-compute[73110]:     </disk>
Aug 26 18:25:05 user nova-compute[73110]:     <interface type="ethernet">
Aug 26 18:25:05 user nova-compute[73110]:       <mac address="fa:16:3e:4e:49:a4"/>
Aug 26 18:25:05 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:25:05 user nova-compute[73110]:       <mtu size="1442"/>
Aug 26 18:25:05 user nova-compute[73110]:       <target dev="tap195189c5-d3"/>
Aug 26 18:25:05 user nova-compute[73110]:     </interface>
Aug 26 18:25:05 user nova-compute[73110]:     <serial type="pty">
Aug 26 18:25:05 user nova-compute[73110]:       <log file="/opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/console.log" append="off"/>
Aug 26 18:25:05 user nova-compute[73110]:     </serial>
Aug 26 18:25:05 user nova-compute[73110]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 18:25:05 user nova-compute[73110]:     <video>
Aug 26 18:25:05 user nova-compute[73110]:       <model type="virtio"/>
Aug 26 18:25:05 user nova-compute[73110]:     </video>
Aug 26 18:25:05 user nova-compute[73110]:     <rng model="virtio">
Aug 26 18:25:05 user nova-compute[73110]:       <backend model="random">/dev/urandom</backend>
Aug 26 18:25:05 user nova-compute[73110]:     </rng>
Aug 26 18:25:05 user nova-compute[73110]:     <controller type="usb" index="0" model="none"/>
Aug 26 18:25:05 user nova-compute[73110]:     <memballoon model="virtio">
Aug 26 18:25:05 user nova-compute[73110]:       <stats period="10"/>
Aug 26 18:25:05 user nova-compute[73110]:     </memballoon>
Aug 26 18:25:05 user nova-compute[73110]:   </devices>
Aug 26 18:25:05 user nova-compute[73110]: </domain>
Aug 26 18:25:05 user nova-compute[73110]:  {{(pid=73110) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-875237925',display_name='tempest-SnapshotDataIntegrityTests-server-875237925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-875237925',id=53,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcoqZJinJWdJzl1r9yHN6qCtB+4uQBwcclJ+6viSN+6XtSc5vkv9heDZy/A1c+/BZeGkQVTnOiHSsMUFeybGjTtjYMhyll24nh0+6ZOIEn7LDqKWr26kLsQ77u3UYa5pA==',key_name='tempest-keypair-858670905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcd65ae37034b468096d79d67af12e3',ramdisk_id='',reservation_id='r-sns4lnux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2067362385',owner_user_name='tempest-SnapshotDataIntegrityTests-2067362385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T18:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f02624dd4641538d232b395307319d',uuid=24dff064-8f29-4056-904d-1c4d07477561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converting VIF {"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG os_vif [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3') {{(pid=73110) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195189c5-d3, may_exist=True, interface_attrs={}) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195189c5-d3, col_values=(('external_ids', {'iface-id': '195189c5-d35f-4500-8e25-e9cf87b978d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:49:a4', 'vm-uuid': '24dff064-8f29-4056-904d-1c4d07477561'}),), if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:05 user nova-compute[73110]: INFO os_vif [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3')
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No VIF found with MAC fa:16:3e:4e:49:a4, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.neutron [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated VIF entry in instance network info cache for port 195189c5-d35f-4500-8e25-e9cf87b978d9. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG nova.network.neutron [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:25:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-25593f3d-dccf-4d7e-9f5e-f8f1153e55bd req-627786a1-1b58-4f76-a272-1dc394e940a5 service nova] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG nova.compute.manager [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] No waiting events found dispatching network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:25:07 user nova-compute[73110]: WARNING nova.compute.manager [req-7882ec37-cc06-4671-9e4d-0ba52c19c716 req-004102da-c411-4cce-b8ec-9537e167d05a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received unexpected event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 for instance with vm_state building and task_state spawning.
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:07 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] No waiting events found dispatching network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:25:09 user nova-compute[73110]: WARNING nova.compute.manager [req-b7b08b36-9de1-438f-9586-15d30c314305 req-04d40f7c-1d97-4b75-88dd-136b6507166a service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received unexpected event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 for instance with vm_state building and task_state spawning.
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693074309.6878815, 24dff064-8f29-4056-904d-1c4d07477561 => Resumed> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] VM Resumed (Lifecycle Event)
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Instance event wait completed in 0 seconds for  {{(pid=73110) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Guest created on hypervisor {{(pid=73110) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Instance spawned successfully.
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_cdrom_bus of ide {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_disk_bus of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_input_bus of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_pointer_model of None {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_video_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Found default for hw_vif_model of virtio {{(pid=73110) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.virt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Emitting event <LifecycleEvent: 1693074309.6918952, 24dff064-8f29-4056-904d-1c4d07477561 => Started> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] VM Started (Lifecycle Event)
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73110) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 26 18:25:09 user nova-compute[73110]: DEBUG nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:25:09 user nova-compute[73110]: INFO nova.compute.manager [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Took 7.83 seconds to build instance.
Aug 26 18:25:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-82ad1789-01fd-4287-9b90-013098d6d59f tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.963s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:25:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:25:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:25:34 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:25:35 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:25:35 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8409MB free_disk=25.0780029296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:25:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:25:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:25:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:26:27 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:26:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:26:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:26:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:26:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:35 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:26:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:26:36 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.065811157226562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:26:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:26:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:43 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:43 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:43 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:47 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:26:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-changed-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG nova.compute.manager [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Refreshing instance network info cache due to event network-changed-195189c5-d35f-4500-8e25-e9cf87b978d9. {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Refreshing network info cache for port 195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated VIF entry in instance network info cache for port 195189c5-d35f-4500-8e25-e9cf87b978d9. {{(pid=73110) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG nova.network.neutron [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:26:53 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-86dabdca-78e2-436e-b443-c0502d79f6d0 req-f5d43334-3d33-4cbd-a4c8-8c02044d4982 service nova] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:26:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:26:59 user nova-compute[73110]: INFO nova.compute.manager [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attaching volume 2f2360f6-d616-4d98-a74a-dbd82cc89a84 to /dev/vdb
Aug 26 18:26:59 user nova-compute[73110]: DEBUG os_brick.utils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6430c70-df82-438c-ad1e-cc8439ec5ba5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[081360e3-0125-44c7-9b9d-3461e6619fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795dc77-32e9-4386-8cbb-ad11efcc9c76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0529a41-8f5d-4e18-a716-5a9e8d48fd69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:26:59 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:27:00 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:27:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdba138-2d87-4bb8-a34c-d71347affcc5]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG os_brick.utils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating existing volume attachment record: 2430397f-f864-4496-ac30-1afce6d03d5b {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:04 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:27:04 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTaAoMSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:27:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:27:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:27:23 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86ace2-68f4-475c-89d7-e69821085b90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:27:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6093252c-d2af-42e5-8e32-d8c19b97a1f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84] added
Aug 26 18:27:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[12079d21-6c04-46b2-9e0a-4ccca1ade92b]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8d493-9925-4c92-965b-1b31646ed9ec]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTaAoMSw {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTaAoMSw" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb80c7-8f5d-4a51-b8f0-d6b7c2cba627]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tTaAoMSw'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b316c9-0d68-4a1a-a308-117823920083]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ffcdc1-d6c6-4888-88c4-a6d986aa1d15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:27:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:27:23 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:27:23 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:27:23 user nova-compute[73110]: 
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b070b-bb15-4ce4-ad98-150b0cff30ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260]
Aug 26 18:27:23 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260] successful.
Aug 26 18:27:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6649a-224c-4146-b2af-ebccb0407f01]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f2f2f-f930-44eb-a231-deb1ff54a1cc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)
Aug 26 18:27:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)
Aug 26 18:27:23 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2317d-6616-4916-8041-13cc67ddd99c]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:27:23 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTaAoMSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26362363939376237', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362363939376237', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:27:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:27:24 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:27:24 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:27:24 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:27:24 user nova-compute[73110]:   <serial>2f2360f6-d616-4d98-a74a-dbd82cc89a84</serial>
Aug 26 18:27:24 user nova-compute[73110]: </disk>
Aug 26 18:27:24 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No VIF found with MAC fa:16:3e:4e:49:a4, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8857dd26-e3d8-455a-9548-df7943c0c75a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.348s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:27:28 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:29 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Triggering sync for uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 18:27:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:27:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:27:29 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:27:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:27:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:36 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73110) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 18:27:37 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:27:37 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.063941955566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:27:37 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:27:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:27:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:27:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:27:57 user nova-compute[73110]: INFO nova.compute.manager [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Detaching volume 2f2360f6-d616-4d98-a74a-dbd82cc89a84
Aug 26 18:27:57 user nova-compute[73110]: INFO nova.virt.block_device [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attempting to driver detach volume 2f2360f6-d616-4d98-a74a-dbd82cc89a84 from mountpoint /dev/vdb
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Attempting to detach device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:27:57 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:27:57 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:27:57 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:27:57 user nova-compute[73110]:   <serial>2f2360f6-d616-4d98-a74a-dbd82cc89a84</serial>
Aug 26 18:27:57 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:27:57 user nova-compute[73110]: </disk>
Aug 26 18:27:57 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:27:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config.
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:27:57 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:27:57 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:27:57 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:27:57 user nova-compute[73110]:   <serial>2f2360f6-d616-4d98-a74a-dbd82cc89a84</serial>
Aug 26 18:27:57 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:27:57 user nova-compute[73110]: </disk>
Aug 26 18:27:57 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693074477.959539, 24dff064-8f29-4056-904d-1c4d07477561 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:27:57 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config.
Aug 26 18:27:57 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTaAoMSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:27:57 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:27:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37be8d7-769b-41d1-8ae4-db141416e505]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:57 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e80dea-a54b-4fea-aebb-4858b8afe96a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)
Aug 26 18:27:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 (non-flash)
Aug 26 18:27:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54426c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[25254fbb-19a0-4d14-b0c7-f2f5bb2174fa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e09039-9967-4068-8e8a-9ada06aa9f40]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d942f9-5458-4b7e-b3f1-67cf33ead0c3]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ff004-6f0f-4742-aea0-c870bd075cb0]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab8889-f08f-4269-91ba-4bd685a12a83]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906ca22-0dcc-4ee9-9e55-e02eeabb5cd7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260]
Aug 26 18:27:58 user nova-compute[73110]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84, portal: 172.16.0.220,3260] successful.
Aug 26 18:27:58 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2360f6-d616-4d98-a74a-dbd82cc89a84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[084922c6-3714-4d74-8644-fda853868336]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== disconnect_volume: return (270ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:27:58 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:27:59 user nova-compute[73110]: DEBUG nova.objects.instance [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:27:59 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-4c9d32cb-3480-45d9-b1cc-13d59fe30899 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:28:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:28:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:28:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:38 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:28:39 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:28:39 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.063064575195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:28:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:43 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:28:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG nova.objects.instance [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:28:51 user nova-compute[73110]: INFO nova.compute.manager [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attaching volume ecc8df6f-99f8-498c-a603-d5803c2597a9 to /dev/vdb
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.utils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f80fa4-eb63-40d5-aa1c-97a61712c3c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f791ee2-fa40-4f31-a279-f0115089cc6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc8260-e52a-4ef2-b478-abd7144a4d1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55b6c8-17d1-4253-9b6b-2e1456719629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:28:51 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:28:51 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e4efee-3050-475b-a88b-d23f96d502fa]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG os_brick.utils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:28:51 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating existing volume attachment record: 5ec2cb6c-cb75-455e-b13e-b8cf5fe3dbbb {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:28:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:28:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:29:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhvkqZIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:29:01 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:29:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:29:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:29:01 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:29:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:29:01 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:29:01 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6117212-e021-4d1a-9929-92ac8368dae6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:29:02 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb09288-445e-485e-9110-4a88bcac43d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9] added
Aug 26 18:29:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58eafa7-abd1-4b61-b66b-df5a326e4ab8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc8225-fb01-4b44-815b-16c8e4f0431c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhvkqZIt {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhvkqZIt" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a95de2-0ff7-4a3d-a846-f8770a8d7e98]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhvkqZIt'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f37e60-9545-47c1-8f1b-93fdd5967b2e]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de1b21b-46c0-4759-9a0f-8d0683fa471f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:29:02 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:29:02 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:29:02 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:29:02 user nova-compute[73110]: 
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2480e-122d-42b2-8573-9e9cae1108c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260]
Aug 26 18:29:02 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260] successful.
Aug 26 18:29:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[221186c7-2118-43ab-944f-153ac64017e2]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[370337d6-9e59-4d61-8d19-bc4f82e39626]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)
Aug 26 18:29:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)
Aug 26 18:29:02 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ede5918-9fd8-4452-9ca5-4f0afd863ba9]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:29:02 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhvkqZIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26266663764383962', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266663764383962', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.objects.instance [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:29:03 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:29:03 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:29:03 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:29:03 user nova-compute[73110]:   <serial>ecc8df6f-99f8-498c-a603-d5803c2597a9</serial>
Aug 26 18:29:03 user nova-compute[73110]: </disk>
Aug 26 18:29:03 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No VIF found with MAC fa:16:3e:4e:49:a4, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:29:03 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-28ddad92-5ae2-4140-9f0b-25c552e27941 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.310s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:29:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:29:05 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:29:05 user nova-compute[73110]: INFO nova.compute.manager [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Detaching volume ecc8df6f-99f8-498c-a603-d5803c2597a9
Aug 26 18:29:05 user nova-compute[73110]: INFO nova.virt.block_device [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attempting to driver detach volume ecc8df6f-99f8-498c-a603-d5803c2597a9 from mountpoint /dev/vdb
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Attempting to detach device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:29:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:29:06 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:29:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:29:06 user nova-compute[73110]:   <serial>ecc8df6f-99f8-498c-a603-d5803c2597a9</serial>
Aug 26 18:29:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:29:06 user nova-compute[73110]: </disk>
Aug 26 18:29:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:29:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config.
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:29:06 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:29:06 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:29:06 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:29:06 user nova-compute[73110]:   <serial>ecc8df6f-99f8-498c-a603-d5803c2597a9</serial>
Aug 26 18:29:06 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:29:06 user nova-compute[73110]: </disk>
Aug 26 18:29:06 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693074546.4349115, 24dff064-8f29-4056-904d-1c4d07477561 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:29:06 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config.
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhvkqZIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:29:06 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966ccac-76af-4197-98c0-1b7c6b70dddc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7677c6-a4de-4f21-83be-b8a465c87ac1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)
Aug 26 18:29:06 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 (non-flash)
Aug 26 18:29:06 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520e44310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[388cb018-083c-48b7-8edf-c01a34ceba8f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc44926-ef5f-49d0-9717-3f8c0d4161be]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8cf5b-06c8-4e31-9075-c41724b4b509]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bfafe8-faea-4117-8fe1-0d916d5042fe]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[30292e64-06a2-434a-af64-4b1730502f2c]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bed0f0-fd6d-43c9-82d4-726c4cf40ade]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260]
Aug 26 18:29:06 user nova-compute[73110]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9, portal: 172.16.0.220,3260] successful.
Aug 26 18:29:06 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc8df6f-99f8-498c-a603-d5803c2597a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf9519-7ed5-4025-aaf3-f73d578a00b8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== disconnect_volume: return (259ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:29:06 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:29:07 user nova-compute[73110]: DEBUG nova.objects.instance [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:29:07 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-556f0ad9-d072-4d8d-a42e-fd3de0ed984a tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:29:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:29 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:29:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:29:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:29:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:29:39 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:29:40 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:29:40 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.062023162841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:29:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:29:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:49 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:29:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:29:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:30:00 user nova-compute[73110]: INFO nova.compute.manager [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attaching volume 51d245c3-cd4e-41ac-a243-75e7db595b9c to /dev/vdb
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.utils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f8b53-fbba-4951-9cb9-168b5adafaea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee5531-b42b-4cb4-b7b8-0bbe1e8326a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9cbd06-8d96-4f5b-927d-00ea36ea4ced]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded36c79-3737-4cd8-98d3-1998f28d3246]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:30:00 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:30:00 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f73bf-abfa-4c86-a98b-c17e61fb47ba]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG os_brick.utils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:30:00 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating existing volume attachment record: 36428d89-32b0-4eee-964e-7a4dac7ebed9 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:30:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKxazrmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:30:10 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:30:10 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:30:10 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f89b6b-a303-42a4-9a2a-03eaf5149b4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:30:10 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9f196-fd20-4b81-b2e9-47408527d9dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c] added
Aug 26 18:30:10 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf806fa-272d-417e-988a-749a866a9358]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:10 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e73814-a57f-40a0-bfb4-aab93e3eb429]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKxazrmY {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKxazrmY" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[71312250-24c6-4f04-9b46-33d3ec03f2d6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKxazrmY'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e763a62-9d06-4003-818f-ca163e76a9a7]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf77bbe-7abc-446c-b00c-5b38d8130af6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:30:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:30:11 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:30:11 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:30:11 user nova-compute[73110]: 
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f450fe-f4f7-43b8-8fcb-162bc375f983]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260]
Aug 26 18:30:11 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260] successful.
Aug 26 18:30:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c444bd1-69bc-4873-b0bf-b7b0afd5c799]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[164625c1-84d8-438c-aed1-deb7df659e97]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)
Aug 26 18:30:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)
Aug 26 18:30:11 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f8ea2-4ea3-46eb-8775-a231b3e566fa]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:11 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKxazrmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23435326236346265', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326236346265', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.objects.instance [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:30:12 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:30:12 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:30:12 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:30:12 user nova-compute[73110]:   <serial>51d245c3-cd4e-41ac-a243-75e7db595b9c</serial>
Aug 26 18:30:12 user nova-compute[73110]: </disk>
Aug 26 18:30:12 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No VIF found with MAC fa:16:3e:4e:49:a4, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:30:12 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-c6ff0248-4a39-435d-b93b-c14f214d2f98 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.284s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:30:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:30:14 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:30:14 user nova-compute[73110]: INFO nova.compute.manager [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Detaching volume 51d245c3-cd4e-41ac-a243-75e7db595b9c
Aug 26 18:30:15 user nova-compute[73110]: INFO nova.virt.block_device [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attempting to driver detach volume 51d245c3-cd4e-41ac-a243-75e7db595b9c from mountpoint /dev/vdb
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Attempting to detach device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:30:15 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:30:15 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:30:15 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:30:15 user nova-compute[73110]:   <serial>51d245c3-cd4e-41ac-a243-75e7db595b9c</serial>
Aug 26 18:30:15 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:30:15 user nova-compute[73110]: </disk>
Aug 26 18:30:15 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:30:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config.
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:30:15 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:30:15 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:30:15 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:30:15 user nova-compute[73110]:   <serial>51d245c3-cd4e-41ac-a243-75e7db595b9c</serial>
Aug 26 18:30:15 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:30:15 user nova-compute[73110]: </disk>
Aug 26 18:30:15 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693074615.4869583, 24dff064-8f29-4056-904d-1c4d07477561 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:30:15 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config.
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKxazrmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:30:15 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f80c2-7f6f-4575-bf7f-58723bb03328]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf174c-0e6d-4a8e-b85e-66ee3c35c64b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)
Aug 26 18:30:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c (non-flash)
Aug 26 18:30:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd520f10b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[293aa72e-0f16-4992-8891-f8f2e0493eec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e3546-ba98-45c5-9eee-7b5cb7e88e6e]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea51ac5-17df-4c08-9071-390004d84f97]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd235d23-fca6-486b-bf97-1d1e715b181b]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f6d06-fb5b-4d58-9161-13ca30210170]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55f91f-992a-4b85-882b-01a0e41ea4c2]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260]
Aug 26 18:30:15 user nova-compute[73110]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c, portal: 172.16.0.220,3260] successful.
Aug 26 18:30:15 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d245c3-cd4e-41ac-a243-75e7db595b9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1044f3-5ef5-44bc-84f4-6ec4c6c41fc6]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== disconnect_volume: return (265ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:30:15 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:30:16 user nova-compute[73110]: DEBUG nova.objects.instance [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:30:16 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-ddf1eed4-d3e4-4600-aae2-19e55f5547e4 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:30 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:30:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:40 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:30:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.06103515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:30:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:45 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:46 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:30:50 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:30:55 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:05 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:31:09 user nova-compute[73110]: INFO nova.compute.manager [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attaching volume b3a6ee37-e4f8-4a58-b730-83a8bc353075 to /dev/vdb
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.utils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[64baf055-b6ca-4f0b-9f26-42998c1bce4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3a7bcdb43fd\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b78ef-60b2-4244-b289-cf9a095f7219]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b263cea-6315-4bbf-8a51-6ca6fcc66299]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a218a-6fe7-43dd-b6f3-4ac0e89c2295]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Running cmd (subprocess): nvme version {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] 'nvme version' failed. Not Retrying. {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] nvme not present on system {{(pid=73110) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 18:31:09 user nova-compute[73110]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 18:31:09 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3ef6d-dfd6-46c5-ba64-f1ee8abc8e11]: (4, '') {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73110) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] LIGHTOS: no hostnqn found. {{(pid=73110) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG os_brick.utils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3a7bcdb43fd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:31:09 user nova-compute[73110]: DEBUG nova.virt.block_device [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating existing volume attachment record: f01aed23-a233-459b-9242-3a0102c0e438 {{(pid=73110) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 18:31:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:10 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:15 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Calling os-brick to attach iSCSI Volume {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUZrjKim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:31:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:31:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:31:19 user nova-compute[73110]: INFO os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdd656-364f-445a-a079-84d97b97e801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 18:31:19 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --interface default --op new {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d0277-8483-412a-b183-79eb8911a0c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075] added\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075] added
Aug 26 18:31:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ad1dd-1298-4d58-aeb1-6cb57c090d31]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b80f525-a9df-4aa4-a0d8-10cafdb21955]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUZrjKim {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUZrjKim" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[43640627-7070-432a-b1e4-8cd7c57c4706]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CUZrjKim'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef49a11-225a-4df9-bc83-2717d1f054b8]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d16cf-d768-4732-bef3-3d3f66a712db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:31:19 user nova-compute[73110]:  {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 18:31:19 user nova-compute[73110]:  {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:31:19 user nova-compute[73110]: WARNING os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 18:31:19 user nova-compute[73110]: 
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --login {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43fc98-4754-435c-af42-137fdfc6492f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260]
Aug 26 18:31:19 user nova-compute[73110]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260] successful.
Aug 26 18:31:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846647c-b54d-4805-9a7d-af0441ba9380]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3085059-1eb0-4729-af80-b8452f41026b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)
Aug 26 18:31:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)
Aug 26 18:31:19 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to 172.16.0.220:3260 {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73110) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73110) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3e933-1852-4bdc-90ad-bf891a91cdc0]: (4, ('- - 0', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73110) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 18:31:19 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUZrjKim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73110) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 18:31:20 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:31:20 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23062653262636436', 'path': '/dev/sdb'} {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:31:20 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062653262636436', 'path': '/dev/sdb'} {{(pid=73110) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 18:31:20 user nova-compute[73110]: DEBUG nova.objects.instance [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:31:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 18:31:21 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:31:21 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:31:21 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:31:21 user nova-compute[73110]:   <serial>b3a6ee37-e4f8-4a58-b730-83a8bc353075</serial>
Aug 26 18:31:21 user nova-compute[73110]: </disk>
Aug 26 18:31:21 user nova-compute[73110]:  {{(pid=73110) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 18:31:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:31:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73110) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 18:31:21 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] No VIF found with MAC fa:16:3e:4e:49:a4, not building metadata {{(pid=73110) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 18:31:21 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-d9f64b10-d8e1-4fd4-9aee-c22b2e693b62 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.297s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:31:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:31:23 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:31:23 user nova-compute[73110]: INFO nova.compute.manager [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Detaching volume b3a6ee37-e4f8-4a58-b730-83a8bc353075
Aug 26 18:31:23 user nova-compute[73110]: INFO nova.virt.block_device [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Attempting to driver detach volume b3a6ee37-e4f8-4a58-b730-83a8bc353075 from mountpoint /dev/vdb
Aug 26 18:31:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Attempting to detach device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config. {{(pid=73110) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 18:31:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:31:23 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:31:23 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:31:23 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:31:23 user nova-compute[73110]:   <serial>b3a6ee37-e4f8-4a58-b730-83a8bc353075</serial>
Aug 26 18:31:23 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:31:23 user nova-compute[73110]: </disk>
Aug 26 18:31:23 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:31:23 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the persistent domain config.
Aug 26 18:31:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config. {{(pid=73110) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 18:31:23 user nova-compute[73110]: DEBUG nova.virt.libvirt.guest [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 18:31:23 user nova-compute[73110]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 18:31:23 user nova-compute[73110]:   <source dev="/dev/sdb"/>
Aug 26 18:31:23 user nova-compute[73110]:   <target dev="vdb" bus="virtio"/>
Aug 26 18:31:23 user nova-compute[73110]:   <serial>b3a6ee37-e4f8-4a58-b730-83a8bc353075</serial>
Aug 26 18:31:23 user nova-compute[73110]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 18:31:23 user nova-compute[73110]: </disk>
Aug 26 18:31:23 user nova-compute[73110]:  {{(pid=73110) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-ae21c0be-b4f4-442b-ae6e-faeefa5194ef None None] Received event <DeviceRemovedEvent: 1693074684.3122394, 24dff064-8f29-4056-904d-1c4d07477561 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73110) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.driver [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 18:31:24 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully detached device vdb from instance 24dff064-8f29-4056-904d-1c4d07477561 from the live domain config.
Aug 26 18:31:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] calling os-brick to detach iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd5445f04c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUZrjKim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 18:31:24 user nova-compute[73110]: WARNING os_brick.initiator.connectors.base [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075', 0)] {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0785571-2a61-4174-810b-6de4de9e2341]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2acf576-dd30-4560-b1a9-b86952267ecb]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)
Aug 26 18:31:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 (non-flash)
Aug 26 18:31:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd54457da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075'): ({'sdb'}, set())}) {{(pid=73110) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Removing single pathed devices sdb {{(pid=73110) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa41f4-b217-4826-b361-b08564989275]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a6e4e-c565-4ac1-b498-de297cd04b39]: (4, ('ok\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Flushing IO for device /dev/sdb {{(pid=73110) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf86477-9925-49bb-bbe4-f5da211be6f4]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73110) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893977b-3ec2-4b5e-ad15-b82f5cfc4e4a]: (4, ('1', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.linuxscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] SCSI volumes sdb have been removed. {{(pid=73110) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075')] {{(pid=73110) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d345d-7cd3-400a-8eed-6506c3de0b13]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --logout {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e99e00-320a-48b2-83d3-9b1bc043b9e2]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260]
Aug 26 18:31:24 user nova-compute[73110]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075, portal: 172.16.0.220,3260] successful.
Aug 26 18:31:24 user nova-compute[73110]:  stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op delete {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a6ee37-e4f8-4a58-b730-83a8bc353075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9c116-7898-4665-a91c-27fec12950c1]: (4, ('', '')) {{(pid=84436) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73110) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.base [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG os_brick.initiator.connectors.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] <== disconnect_volume: return (261ms) None {{(pid=73110) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 18:31:24 user nova-compute[73110]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Disconnected iSCSI Volume {{(pid=73110) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 18:31:25 user nova-compute[73110]: DEBUG nova.objects.instance [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'flavor' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:31:25 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-8261bcdf-e0a6-4d82-94a7-3f301a142472 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:31:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:25 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:30 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:31 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:31:32 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:31:35 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:37 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:37 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:37 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:31:40 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:31:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:31:41 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.060012817382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing inventories for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating ProviderTree inventory for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Updating inventory in ProviderTree for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing aggregate associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, aggregates: None {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Refreshing trait associations for resource provider 166b0a1a-be79-4fde-8303-88dbbf28dbea, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=73110) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:31:41 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:31:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:31:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:51 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:51 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73110) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 18:31:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:31:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:07 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Cleaning up deleted instances {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 18:32:07 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] There are 0 instances to clean {{(pid=73110) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 18:32:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquired lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Forcefully refreshing network info cache for instance {{(pid=73110) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.objects.instance [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lazy-loading 'info_cache' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.network.neutron [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [{"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Releasing lock "refresh_cache-24dff064-8f29-4056-904d-1c4d07477561" {{(pid=73110) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updated the network info_cache for instance {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:33 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:32:36 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:38 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:32:39 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 18:32:42 user nova-compute[73110]: DEBUG oslo_concurrency.processutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 18:32:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:32:43 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.05915069580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Instance 24dff064-8f29-4056-904d-1c4d07477561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73110) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:32:43 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:32:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:48 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:50 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:32:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:32:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:00 user nova-compute[73110]: INFO nova.compute.manager [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Terminating instance
Aug 26 18:33:00 user nova-compute[73110]: DEBUG nova.compute.manager [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Start destroying the instance on the hypervisor. {{(pid=73110) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-unplugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] No waiting events found dispatching network-vif-unplugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG nova.compute.manager [req-8d8a2fcc-3cf8-47ef-81f8-b360259b4834 req-10924998-9626-4324-94b7-5885a5c8e38f service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-unplugged-195189c5-d35f-4500-8e25-e9cf87b978d9 for instance with task_state deleting. {{(pid=73110) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 18:33:00 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:00 user nova-compute[73110]: INFO nova.virt.libvirt.driver [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Instance destroyed successfully.
Aug 26 18:33:00 user nova-compute[73110]: DEBUG nova.objects.instance [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lazy-loading 'resources' on Instance uuid 24dff064-8f29-4056-904d-1c4d07477561 {{(pid=73110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG nova.virt.libvirt.vif [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T18:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-875237925',display_name='tempest-SnapshotDataIntegrityTests-server-875237925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-875237925',id=53,image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcoqZJinJWdJzl1r9yHN6qCtB+4uQBwcclJ+6viSN+6XtSc5vkv9heDZy/A1c+/BZeGkQVTnOiHSsMUFeybGjTtjYMhyll24nh0+6ZOIEn7LDqKWr26kLsQ77u3UYa5pA==',key_name='tempest-keypair-858670905',keypairs=<?>,launch_index=0,launched_at=2023-08-26T18:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edcd65ae37034b468096d79d67af12e3',ramdisk_id='',reservation_id='r-sns4lnux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4299a158-616a-46c3-b665-9d8a5d47a509',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2067362385',owner_user_name='tempest-SnapshotDataIntegrityTests-2067362385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T18:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f02624dd4641538d232b395307319d',uuid=24dff064-8f29-4056-904d-1c4d07477561,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converting VIF {"id": "195189c5-d35f-4500-8e25-e9cf87b978d9", "address": "fa:16:3e:4e:49:a4", "network": {"id": "0fbc2fd4-b907-441f-9476-8e01f4f4897a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1092517508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcd65ae37034b468096d79d67af12e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195189c5-d3", "ovs_interfaceid": "195189c5-d35f-4500-8e25-e9cf87b978d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG nova.network.os_vif_util [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3') {{(pid=73110) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG os_vif [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3') {{(pid=73110) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195189c5-d3, bridge=br-int, if_exists=True) {{(pid=73110) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:01 user nova-compute[73110]: INFO os_vif [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:49:a4,bridge_name='br-int',has_traffic_filtering=True,id=195189c5-d35f-4500-8e25-e9cf87b978d9,network=Network(0fbc2fd4-b907-441f-9476-8e01f4f4897a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195189c5-d3')
Aug 26 18:33:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Deleting instance files /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561_del
Aug 26 18:33:01 user nova-compute[73110]: INFO nova.virt.libvirt.driver [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Deletion of /opt/stack/data/nova/instances/24dff064-8f29-4056-904d-1c4d07477561_del complete
Aug 26 18:33:01 user nova-compute[73110]: INFO nova.compute.manager [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 18:33:01 user nova-compute[73110]: DEBUG oslo.service.loopingcall [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73110) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG nova.compute.manager [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Deallocating network for instance {{(pid=73110) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 18:33:01 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] deallocate_for_instance() {{(pid=73110) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.network.neutron [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Updating instance_info_cache with network_info: [] {{(pid=73110) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 18:33:02 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Took 1.31 seconds to deallocate network for instance.
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:02 user nova-compute[73110]: INFO nova.scheduler.client.report [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Deleted allocations for instance 24dff064-8f29-4056-904d-1c4d07477561
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] Acquiring lock "24dff064-8f29-4056-904d-1c4d07477561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] Lock "24dff064-8f29-4056-904d-1c4d07477561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] No waiting events found dispatching network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 18:33:02 user nova-compute[73110]: WARNING nova.compute.manager [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received unexpected event network-vif-plugged-195189c5-d35f-4500-8e25-e9cf87b978d9 for instance with vm_state deleted and task_state None.
Aug 26 18:33:02 user nova-compute[73110]: DEBUG nova.compute.manager [req-cce0eaaf-63cc-4b00-b0f8-ac944ed4ee78 req-856d2462-10b0-494c-844a-1e840a6be562 service nova] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Received event network-vif-deleted-195189c5-d35f-4500-8e25-e9cf87b978d9 {{(pid=73110) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 18:33:02 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-baddcf2f-49c4-4c7f-a014-8b9300613386 tempest-SnapshotDataIntegrityTests-2067362385 tempest-SnapshotDataIntegrityTests-2067362385-project-member] Lock "24dff064-8f29-4056-904d-1c4d07477561" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:15 user nova-compute[73110]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693074780.9801939, 24dff064-8f29-4056-904d-1c4d07477561 => Stopped> {{(pid=73110) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 18:33:15 user nova-compute[73110]: INFO nova.compute.manager [-] [instance: 24dff064-8f29-4056-904d-1c4d07477561] VM Stopped (Lifecycle Event)
Aug 26 18:33:16 user nova-compute[73110]: DEBUG nova.compute.manager [None req-563d9786-12f7-411f-8d86-bc53a0b89a13 None None] [instance: 24dff064-8f29-4056-904d-1c4d07477561] Checking state {{(pid=73110) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 18:33:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:26 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:31 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:34 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Starting heal instance info cache {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 18:33:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Rebuilding the list of instances to heal {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 18:33:35 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Didn't find any instances for network info cache update. {{(pid=73110) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 18:33:35 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:36 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:38 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:39 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:40 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:40 user nova-compute[73110]: DEBUG nova.compute.manager [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73110) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:41 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Auditing locally available compute resources for user (node: user) {{(pid=73110) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 18:33:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:33:42 user nova-compute[73110]: WARNING nova.virt.libvirt.driver [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.08652114868164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73110) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73110) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.provider_tree [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed in ProviderTree for provider: 166b0a1a-be79-4fde-8303-88dbbf28dbea {{(pid=73110) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.scheduler.client.report [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Inventory has not changed for provider 166b0a1a-be79-4fde-8303-88dbbf28dbea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73110) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG nova.compute.resource_tracker [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Compute_service record updated for user:user {{(pid=73110) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 18:33:42 user nova-compute[73110]: DEBUG oslo_concurrency.lockutils [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73110) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 18:33:46 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:51 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:52 user nova-compute[73110]: DEBUG oslo_service.periodic_task [None req-cd323508-b666-457b-99f8-9ad8568d503e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73110) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 18:33:54 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:56 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:33:58 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:01 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:06 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:11 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73110) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73110) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 18:34:16 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 18:34:21 user nova-compute[73110]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73110) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}